-- Logs begin at Wed 2022-09-21 11:39:21 UTC, end at Wed 2022-09-21 12:46:56 UTC. -- Sep 21 12:11:41.759259 dv-cinder-858678-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 21 12:11:41.771776 dv-cinder-858678-1-iscsi devstack@n-api.service[105418]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 21 12:11:41.773802 dv-cinder-858678-1-iscsi devstack@n-api.service[105418]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 21 12:11:41 2022] *** Sep 21 12:11:41.773802 dv-cinder-858678-1-iscsi devstack@n-api.service[105418]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 21 12:11:41.773802 dv-cinder-858678-1-iscsi devstack@n-api.service[105418]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 21 12:11:41.773802 dv-cinder-858678-1-iscsi devstack@n-api.service[105418]: nodename: dv-cinder-858678-1-iscsi Sep 21 12:11:41.773802 dv-cinder-858678-1-iscsi devstack@n-api.service[105418]: machine: x86_64 Sep 21 12:11:41.773802 dv-cinder-858678-1-iscsi devstack@n-api.service[105418]: clock source: unix Sep 21 12:11:41.773802 dv-cinder-858678-1-iscsi devstack@n-api.service[105418]: pcre jit disabled Sep 21 12:11:41.773802 dv-cinder-858678-1-iscsi devstack@n-api.service[105418]: detected number of CPU cores: 4 Sep 21 12:11:41.773802 dv-cinder-858678-1-iscsi devstack@n-api.service[105418]: current working directory: / Sep 21 12:11:41.773802 dv-cinder-858678-1-iscsi devstack@n-api.service[105418]: detected binary path: /usr/bin/uwsgi-core Sep 21 12:11:41.774382 dv-cinder-858678-1-iscsi devstack@n-api.service[105418]: your processes number limit is 47680 Sep 21 12:11:41.774382 dv-cinder-858678-1-iscsi devstack@n-api.service[105418]: your memory page size is 4096 bytes Sep 21 12:11:41.774382 dv-cinder-858678-1-iscsi devstack@n-api.service[105418]: detected max file descriptor number: 2048 Sep 21 12:11:41.774382 dv-cinder-858678-1-iscsi devstack@n-api.service[105418]: lock engine: pthread robust mutexes Sep 21 12:11:41.774382 dv-cinder-858678-1-iscsi devstack@n-api.service[105418]: thunder lock: enabled Sep 21 12:11:41.774382 dv-cinder-858678-1-iscsi devstack@n-api.service[105418]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 21 12:11:41.774382 dv-cinder-858678-1-iscsi devstack@n-api.service[105418]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 21 12:11:41.813822 dv-cinder-858678-1-iscsi devstack@n-api.service[105418]: Python main interpreter initialized at 0x55f3a05159c0 Sep 21 12:11:41.813822 dv-cinder-858678-1-iscsi devstack@n-api.service[105418]: python threads support enabled Sep 21 12:11:41.813822 dv-cinder-858678-1-iscsi devstack@n-api.service[105418]: your server socket listen backlog is limited to 100 connections Sep 21 12:11:41.813822 dv-cinder-858678-1-iscsi devstack@n-api.service[105418]: your mercy for graceful operations on workers is 90 seconds Sep 21 12:11:41.814237 dv-cinder-858678-1-iscsi devstack@n-api.service[105418]: mapped 403077 bytes (393 KB) for 2 cores Sep 21 12:11:41.814237 dv-cinder-858678-1-iscsi devstack@n-api.service[105418]: *** Operational MODE: preforking *** Sep 21 12:11:41.814519 dv-cinder-858678-1-iscsi devstack@n-api.service[105418]: *** uWSGI is running in multiple interpreter mode *** Sep 21 12:11:41.814519 dv-cinder-858678-1-iscsi devstack@n-api.service[105418]: spawned uWSGI master process (pid: 105418) Sep 21 12:11:41.814692 dv-cinder-858678-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 21 12:11:41.817165 dv-cinder-858678-1-iscsi devstack@n-api.service[105418]: spawned uWSGI worker 1 (pid: 105419, cores: 1) Sep 21 12:11:41.817165 dv-cinder-858678-1-iscsi devstack@n-api.service[105418]: spawned uWSGI worker 2 (pid: 105420, cores: 1) Sep 21 12:11:41.817165 dv-cinder-858678-1-iscsi devstack@n-api.service[105418]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 21 12:11:42.508183 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 21 12:11:42.519856 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 21 12:11:43.617667 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 12:11:43.617667 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: from cryptography.utils import int_from_bytes Sep 21 12:11:43.618397 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 12:11:43.618397 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: from cryptography.utils import int_from_bytes Sep 21 12:11:43.643159 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 12:11:43.643159 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: from cryptography.utils import int_from_bytes Sep 21 12:11:43.643654 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 12:11:43.643654 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: from cryptography.utils import int_from_bytes Sep 21 12:11:46.135780 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 21 12:11:46.136463 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 21 12:11:46.136575 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 21 12:11:46.136575 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 21 12:11:46.137009 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 21 12:11:46.137009 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 21 12:11:46.137247 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 21 12:11:46.137386 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 21 12:11:46.137523 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 21 12:11:46.137617 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.137693 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 21 12:11:46.137887 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.138042 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.138176 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.138963 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.139101 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.139294 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.139436 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.139618 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.139748 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.139977 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.140090 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.140290 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.140409 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.140615 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.140736 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.140944 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.141056 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.141275 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.141358 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.141537 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.141626 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-858678-1-iscsi {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.141859 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.141955 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.142180 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-858678-1-iscsi {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.142266 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.142503 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.142594 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.142815 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.142917 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.143113 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.143202 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.143437 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.143587 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.143766 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.143883 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.144087 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.144279 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.144392 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.145589 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.145704 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.145785 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.145850 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.145914 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.145988 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.146065 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.146130 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.146201 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.146271 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.146335 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.146414 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.146725 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.146831 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.146909 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.147004 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.147220 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.147334 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.147543 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.147647 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.148017 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-858678-1-iscsi {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.148153 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.148228 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.148470 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-858678-1-iscsi {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.148593 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.148762 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.148860 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.149057 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.149239 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.149416 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.149534 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.149806 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.150018 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.150214 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.150442 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.150641 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.150841 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.151064 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.151263 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.151263 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.151677 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.151677 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.152078 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.152078 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.152494 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.152617 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.152864 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.152949 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.153122 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.153217 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.153290 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.153363 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.153554 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.153650 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.153718 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.153782 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.153856 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.153932 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.154688 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.154823 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.154965 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.155100 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.155241 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.155385 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.155521 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.155663 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.155886 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.156037 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.156197 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.156333 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.156480 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.156615 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.156751 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.156897 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.157039 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.157185 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.157321 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.157456 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.157590 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.157747 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.157891 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.158027 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.158160 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.158293 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.158435 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.158571 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.158712 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.158847 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.158987 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.159121 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.159263 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.159397 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.159544 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.159679 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.159858 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.159999 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.160145 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.160288 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.160423 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.160564 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.160705 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.160851 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.160997 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.161132 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.71 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.161267 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.161410 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.71 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.161554 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.161689 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.161937 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.71 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.162113 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.162252 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.71 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.162395 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.162530 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.162672 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.162814 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.162957 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.163093 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.163236 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.163371 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.163517 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.163653 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.163842 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.163993 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.164129 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.164262 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.164424 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.164575 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.164711 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.164845 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.164978 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.165162 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.165318 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.165501 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.165654 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.165791 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.165931 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.166075 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.166209 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.166344 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.166532 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.166670 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.166805 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.166953 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.167098 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.167232 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.167367 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.167534 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.167675 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.167864 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.168006 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.168167 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.168314 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.168476 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.168615 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.168783 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.168923 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.169089 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.169230 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.169394 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.169534 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.170255 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.170400 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.170537 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.170671 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.170813 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.170957 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.171133 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.171275 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.171451 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.171604 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.171746 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.171941 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.172077 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.172211 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.172359 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.172494 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.172666 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.172816 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.172986 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.173136 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.173363 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.173512 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.173654 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.173788 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.173930 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.174065 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.174199 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.174340 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.174490 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.174638 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.174792 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.174927 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.175074 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.175209 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.175353 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.175496 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.175665 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.175854 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.175994 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.176128 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.176277 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.176428 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.176578 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.176714 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.176879 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.177028 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.177185 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.177348 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.177484 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.177617 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.177780 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.177921 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.178084 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.178239 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.178375 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.178508 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.178677 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.178818 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.178962 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.179096 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.179263 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.179410 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.179567 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.179706 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.179892 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.180030 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.180198 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.180340 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.180503 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.180641 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.180810 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.180952 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.181130 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.181278 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.181441 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.181590 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.181751 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.181892 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.182072 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:11:46.182221 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.182410 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.182561 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.182742 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.182882 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.183072 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.183221 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.183390 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.183541 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.183702 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.183869 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.184042 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.184184 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.184371 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.184513 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.184685 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.184825 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.184998 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.185168 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.185336 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.185479 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.185658 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.185799 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.185977 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.186126 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.186292 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.186446 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.186604 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.186752 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.186917 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.187057 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.187238 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.187388 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.187551 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.187692 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.187895 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.188047 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.188220 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.188371 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.188537 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.188683 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.188848 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.188989 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.189177 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.189329 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.189502 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.189643 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.189815 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.189956 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.190138 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.190278 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.190459 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.190600 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.190769 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.190919 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.191085 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.191243 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.191380 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.191521 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.191722 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.191919 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.192057 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.192191 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.192362 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.192505 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.192680 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.192828 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.192993 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.193143 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.193312 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.193451 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.193623 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.193770 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.193935 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.194074 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.194243 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.194391 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.194541 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.194677 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.194851 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.194992 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.195163 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.195312 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.195526 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.195668 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.195839 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.195980 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.196116 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.196257 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.196405 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.196540 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.196715 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.196856 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.197027 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.197175 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.197331 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.197466 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.197638 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.197789 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.197932 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.198077 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.198213 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.198355 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.198521 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.198662 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.198829 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.198978 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.199114 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.199259 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.199401 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.199545 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.199716 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.199910 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.200055 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.200190 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.200356 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.200498 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.200666 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.200826 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.201008 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.201168 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.201305 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.201440 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.201614 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.201769 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.201907 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.202043 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.202212 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.202353 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.202523 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.202665 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.202825 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.202968 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.203139 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.203279 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.203446 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.203594 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.203729 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.203943 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.204089 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.204232 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.204377 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.204523 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.204660 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.204794 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.204967 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.205119 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.205268 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.205411 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.205575 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.205727 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.205888 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.206042 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.206180 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.206314 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.206502 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.206644 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.206817 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.206971 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.207119 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.207253 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.207433 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.207575 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.207765 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.207925 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.208062 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.208196 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.208387 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.208536 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.208710 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.208860 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.209009 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.209143 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.209314 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.209454 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.209621 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.209763 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.209924 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.210072 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.210229 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.210371 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.210515 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.210658 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.210820 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.210972 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.211128 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.211269 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.211414 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.211549 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.211717 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.211900 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.212099 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.212288 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.212437 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.212579 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.212727 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.212869 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.213027 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.213429 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.213572 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.213713 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.213853 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.213992 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.214133 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.214287 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.214430 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.214570 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.214711 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.214859 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.215001 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.215163 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.215312 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.215454 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.215605 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.215776 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.215944 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.216109 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.216299 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.216954 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.217092 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.217225 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.217374 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.217521 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.217664 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.217805 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.217947 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.218082 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.218231 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.218367 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.218547 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.218688 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.218857 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.218998 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.219178 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.219327 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.219472 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.219608 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.219812 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.219958 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.220127 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.220281 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.220424 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.220564 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.220738 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.220894 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.221038 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.221177 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.221365 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.221523 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.221676 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.221827 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.221977 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.222128 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.222282 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.222423 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.222604 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.222762 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.222906 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.223047 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.223194 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.223336 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.223491 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.223652 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.223856 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.224005 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.224155 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.224297 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.224509 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.224652 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.224800 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.224950 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.225093 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.225233 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.225383 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.225536 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.225677 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.225825 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.225968 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.226120 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.226271 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.226420 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.226562 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.226702 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.226843 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.226983 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.227133 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.227275 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.227427 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.227568 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.227709 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.227888 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.228042 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.228185 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.228348 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.228506 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.228649 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.228799 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.228941 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.229081 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.229233 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.229374 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.229536 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.229718 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.229868 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.230039 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.230189 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.230353 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.230501 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.230651 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.230793 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.230955 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.231111 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.231264 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.231406 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.231579 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.231736 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.231910 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.232052 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.232761 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.232919 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.233063 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.233212 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.233356 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.233508 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.233651 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.233811 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.233954 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.234095 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.234270 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.234428 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.234571 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.234722 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.234871 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.235018 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.235168 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.235310 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.235452 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.235601 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.235836 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.235987 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.236144 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.236298 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.236450 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.236661 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.236822 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.236968 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.237110 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.237251 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.237404 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.237547 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.237687 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.237838 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.237980 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.238128 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.238278 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.238420 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.238561 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.238710 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.238851 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.239000 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.239150 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.239292 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.239433 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.239583 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.239725 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.239901 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.240045 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.240186 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.240334 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.240476 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.240617 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.240767 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.240909 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.241057 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.241199 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.241347 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.241506 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.241661 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.241805 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.241946 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.242087 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.242228 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.242382 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.242534 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.242688 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.242831 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.242971 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.243111 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.243260 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.243418 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.243568 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.243710 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.243960 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.244073 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.244267 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.244407 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.244581 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.244734 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.244901 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.245050 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.245366 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.245533 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.245685 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.245827 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.246006 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.246162 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.246335 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.246493 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.246635 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.246781 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.246936 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.247089 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.247231 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.247379 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.247550 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.248298 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.248521 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.248670 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.248811 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.248952 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.249174 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.249327 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.249471 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.249612 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.249766 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.249915 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.250070 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.250224 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.250366 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.250506 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.250647 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.250801 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.250943 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.251084 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.251233 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.251508 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.251657 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.251843 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.252032 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.252187 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.252414 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.252561 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.252731 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.252965 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.253114 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.253334 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.253480 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.253631 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.253907 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.254064 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.254247 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.254394 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.254556 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.254846 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.255004 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.255147 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.255480 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.255629 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.255850 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.256116 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.256365 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.256607 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.256855 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.257088 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.257316 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.257601 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.257849 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.258083 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.258315 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.258554 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.258809 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.258970 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.259129 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.259282 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.259425 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.259425 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.259704 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.259888 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.260045 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.260207 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.260207 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.260487 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.260630 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.260780 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.260923 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.261064 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.261214 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.261357 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.261498 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.261655 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.261807 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.261807 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.262163 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.262306 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.262471 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.262623 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.262767 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.262908 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.263048 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.263235 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.264184 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.264342 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.264588 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.264759 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.264904 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.265055 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.265055 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.265335 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.265477 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.265477 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.265745 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.265888 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.265888 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.266167 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.266308 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.266308 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.266620 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.266768 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.266965 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.267112 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.267253 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.267527 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.267676 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.268139 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.268295 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.268487 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.268714 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.268862 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.269125 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.269293 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.269437 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.269745 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.269892 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.270056 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.270284 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.270542 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.270786 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.271018 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.271257 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.271497 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.271734 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.271957 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.272114 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.272267 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.272410 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.272551 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.272701 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.272701 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.272981 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.273130 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.273130 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.273403 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.273553 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.273704 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.273855 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.274034 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.274268 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.274511 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.274767 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.274950 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.275102 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.275253 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.275397 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.275538 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.275688 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.275688 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.275984 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.276137 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.276279 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.276469 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.276614 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.276869 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.277024 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.277175 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.277467 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.277633 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.277785 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.278064 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.278262 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.278501 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.278763 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.279050 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.279286 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.279526 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.279821 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.280073 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.280318 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.280578 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.280828 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.281058 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.281412 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.281561 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.281713 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.281875 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.282018 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.282158 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.282299 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.282439 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.282595 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.282747 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.282890 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.283031 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.283171 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.283171 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.283519 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.283664 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.283846 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.283992 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.283992 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.284271 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.284423 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.284423 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.284694 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.284843 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.284843 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.285133 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.285375 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.285375 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.285866 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.286095 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.286353 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.286604 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.286836 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.287075 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.287303 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.287509 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.287656 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.287868 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.288209 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.288358 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.288500 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.288660 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.288803 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.288954 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.288954 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.289242 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.289392 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.289392 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.289660 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.289815 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.289960 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.290101 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.290101 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.290368 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.290528 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.290528 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.290805 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.290945 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.291086 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.291226 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.291226 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.291514 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.291656 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.291824 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.291972 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.291972 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.292250 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.292413 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.292562 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.292703 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.292703 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.292978 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.293130 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.293302 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.293459 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.293632 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.293778 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.293929 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.294264 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.294423 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.294698 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.294856 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.294998 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.295263 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.295413 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.295613 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.295810 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.295961 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.296248 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.296408 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.296578 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.296726 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.296885 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.297176 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.297324 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.297474 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.297677 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.297826 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.298095 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.298241 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.298418 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.298633 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.298836 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.299113 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.299260 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.299446 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.299811 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.299977 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.300211 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.300358 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.300527 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.300793 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.300950 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.301165 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.301320 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.301496 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.301764 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.301922 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.302111 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.302258 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.302425 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.302742 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.302889 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.303066 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.303221 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.303384 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.303707 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.303898 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.304050 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.304353 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.304512 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.304678 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.304862 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.305010 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.305305 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.305466 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.305723 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.305898 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.306054 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.306287 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.306435 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.306664 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.306811 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.306993 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.307236 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.307385 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.307594 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.307749 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.307946 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.308226 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.308373 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.308536 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.308685 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.308862 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.309160 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.309310 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.309462 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.309665 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.309814 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.310076 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.310785 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.310940 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.311170 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.311319 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.311545 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.311856 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.312074 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.312223 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.312417 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.312571 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.312807 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.312963 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.313127 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.313429 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.313585 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.313755 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.313928 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.314088 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.314363 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.314510 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.314652 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.314908 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.315057 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.315296 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.315444 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.315608 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.315943 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.316097 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.316291 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.316488 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.316634 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.316910 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.317059 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.317245 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.317405 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.317556 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.317884 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.318032 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.318198 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.318394 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.318551 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.318830 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.318978 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.319140 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.319369 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.319517 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.319745 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.319936 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.320089 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.320374 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.320524 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.320667 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.320881 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.321044 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.321276 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.321424 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.321580 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.321868 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.322026 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.322179 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.322487 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.322635 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.322812 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.322969 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.323112 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.323255 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.323418 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.323568 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.323711 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.323898 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.324043 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.324193 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.324363 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.324508 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.324674 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.324832 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.325007 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.325164 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.325307 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.325448 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.325639 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.325818 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.326547 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.326702 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.326877 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.327045 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.327202 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.327345 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.327508 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.327800 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.327955 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.328169 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.328325 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.328475 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.328714 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.328862 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.329096 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.329242 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.329408 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.329665 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.329822 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.330164 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.330312 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.330648 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.330847 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.331016 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.331163 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.331343 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.331627 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.331814 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.332059 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.332207 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.332379 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.332622 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.332769 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.332996 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.333143 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.333309 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.333570 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.333718 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.333946 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.334111 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.334262 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.334584 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.334732 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.334924 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.335082 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.335249 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.335397 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.335570 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.335717 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.335923 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.336077 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.336228 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.336380 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.336565 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.336730 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.336887 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.336983 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.337197 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.337285 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.337518 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.337605 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.337836 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.337944 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.338408 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.338510 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.338724 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.338812 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.339041 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.339286 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.339372 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.339667 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.339862 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.340010 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.340252 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.340403 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.340604 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.340760 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.340910 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.341183 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.341343 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.341614 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.341769 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.341938 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.342160 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.342323 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.342561 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.342717 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.342862 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.343082 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.343412 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.343581 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.343724 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.344064 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.344214 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.344396 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.344561 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.344704 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.345023 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.345172 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.345341 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.345540 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.345703 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.345969 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.346139 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.346283 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.346487 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.346636 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.346790 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.346933 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.347142 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.347293 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.347443 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.347586 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.347836 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.347999 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.348142 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.348301 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.348443 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.348598 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.348750 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.348891 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.349110 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.349263 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.349435 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.349593 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.349759 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.349908 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.350085 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.350245 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.350513 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.350668 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.350836 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.351055 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.351204 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.351471 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.351619 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.351811 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.352051 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.352211 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.352408 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.352564 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.352724 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.353015 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.353165 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.353306 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.353621 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.353864 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.354022 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.354228 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.354376 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.354544 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.354853 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.355010 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.355171 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.355323 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.355464 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.355789 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.355952 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.356096 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.356304 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.356453 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.356700 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.356848 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.357050 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.357358 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.357508 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.357673 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.357847 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.357997 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.358173 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.358331 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.358481 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.358624 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.358823 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.358972 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.359139 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.359295 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.359472 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.359620 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.359805 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.359955 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.360097 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.360249 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.360424 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.360573 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.360724 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.360874 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.361030 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.361173 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.361336 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.361485 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.361649 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.361944 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.362136 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.362283 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.362426 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.362567 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.362877 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.363034 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.363186 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.363360 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.363728 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.363916 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.364076 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.364341 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.364497 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.364722 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.364871 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.365057 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.365301 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.365460 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.365661 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.365810 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.365952 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.366251 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.366401 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.366562 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.366730 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.366879 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.367178 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.367326 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.367477 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.367686 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.367860 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.368115 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.368263 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.368417 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.368724 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.368882 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.369026 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.369297 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.369447 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.369629 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.369786 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.369929 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.370215 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.370363 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.370534 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.370690 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.370834 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.371133 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.371301 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.371444 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.371586 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.371819 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.371975 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.372117 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.372258 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.372441 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.372592 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.373282 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.373438 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.373581 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.373731 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.373882 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.374034 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.374176 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.374325 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.374491 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.374646 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.374820 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.374977 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.375122 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.375264 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.375412 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.375555 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.375740 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.376077 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.376225 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.376375 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.376518 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.376694 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.376842 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.376993 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.377144 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.377388 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.377535 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.377716 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.377883 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.378027 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.378170 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.378345 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.378494 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.378805 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.378961 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.379106 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.379248 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.379418 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.379566 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.379747 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.379972 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.380128 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.380272 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.380413 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.380554 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.380772 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.380916 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.381064 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.381208 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.381356 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.381506 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.381661 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.381811 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.381973 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.382115 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.382257 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.382398 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.382548 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.382691 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.382832 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.382974 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.383114 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.383255 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.383416 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.383566 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.383708 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.383894 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.384038 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.384191 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.384337 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.384478 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.384650 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.384799 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.384950 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.385102 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.385246 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.385389 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.385531 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.385680 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.385879 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.386038 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.386182 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.386323 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.386466 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.386607 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.386795 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.386952 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.387097 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.387238 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.387380 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.387523 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.387678 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.387878 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.388026 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.388168 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.388412 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.389059 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.389172 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.389260 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.389348 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.389417 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.389584 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.389708 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.389905 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.390034 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.390217 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.390351 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.390541 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.390675 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.390855 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.390989 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.391168 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.391313 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.391514 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.391639 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.391854 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.391992 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.392309 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.392391 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.392647 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.392745 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.392963 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.393048 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.393278 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.393368 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.393596 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.393689 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.393911 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.393995 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.394225 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.394309 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.394542 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.394720 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.394869 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.395012 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.395155 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.395304 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.395460 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.395604 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.395746 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.395918 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.396072 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.396233 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.396386 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.396529 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.396678 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.396827 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.396977 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.397122 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.397278 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.397421 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.397562 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.397703 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.397843 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.397995 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.398157 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.398300 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.398442 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.398582 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.398722 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.398872 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.399015 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.399158 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.399322 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.399471 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.399664 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.399868 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.400031 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.400174 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.400315 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.400490 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.400643 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.400793 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.400943 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.401086 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.401228 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.401369 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.401519 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.401662 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.401815 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.401974 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.402117 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.402292 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.402451 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.402594 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.402735 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.402943 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.403092 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.403274 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.403424 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.403591 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.403985 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.404160 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.404306 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.404455 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.404598 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 21 12:11:46.404740 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.404994 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.405313 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.405642 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.405968 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.406284 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.406609 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.406923 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.407255 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.407596 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.407950 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.408280 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.408588 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.408896 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.409202 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.409514 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.409832 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.410142 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.410449 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.410754 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.411065 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.411371 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.411676 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.412008 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.412311 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.412621 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.412925 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.413228 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.413531 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.413835 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.414138 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.414439 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.414750 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.415054 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.415360 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.415661 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.415990 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.416292 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.416618 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.416952 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.417268 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.417590 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.417904 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.418227 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.418538 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.418859 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.419181 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.419524 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.419882 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.420221 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.420533 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.420844 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.421159 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.421473 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.421786 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.422102 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.422432 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.422759 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.423065 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.423388 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.423709 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.424055 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.424371 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.424685 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.425016 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.425329 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.425643 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.425957 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.426272 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.426585 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.426904 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.427217 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.427529 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.427872 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.428192 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.428522 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.428849 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.429160 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.429486 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.429812 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.430166 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.430482 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.430832 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.431161 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.431478 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.431822 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.432132 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:11:46.432376 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 21 12:11:46.558747 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO dbcounter [None req-a86fa20a-9352-431e-a1d1-cd549f0e8b72 None None] Registered counter for database nova_api Sep 21 12:11:46.581299 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG oslo_db.sqlalchemy.engines [None req-a86fa20a-9352-431e-a1d1-cd549f0e8b72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105419) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 12:11:46.586305 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO dbcounter [None req-ab4d4514-4b67-49a3-bd7f-7b2942a8006a None None] Registered counter for database nova_api Sep 21 12:11:46.587939 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG dbcounter [-] [105419] Writer thread running {{(pid=105419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 12:11:46.607639 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG oslo_db.sqlalchemy.engines [None req-ab4d4514-4b67-49a3-bd7f-7b2942a8006a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105420) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 12:11:46.614682 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writer thread running {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 12:11:46.647848 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.context [None req-a86fa20a-9352-431e-a1d1-cd549f0e8b72 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5e3c3fc2-6e53-4c4a-a73a-c41818930d93(cell1) {{(pid=105419) load_cells /opt/stack/nova/nova/context.py:464}} Sep 21 12:11:46.651708 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-a86fa20a-9352-431e-a1d1-cd549f0e8b72 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:11:46.652209 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-a86fa20a-9352-431e-a1d1-cd549f0e8b72 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:11:46.653778 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-a86fa20a-9352-431e-a1d1-cd549f0e8b72 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:11:46.654565 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-a86fa20a-9352-431e-a1d1-cd549f0e8b72 None None] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:11:46.655017 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-a86fa20a-9352-431e-a1d1-cd549f0e8b72 None None] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:11:46.657061 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-a86fa20a-9352-431e-a1d1-cd549f0e8b72 None None] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:11:46.659098 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO dbcounter [None req-a86fa20a-9352-431e-a1d1-cd549f0e8b72 None None] Registered counter for database nova_cell0 Sep 21 12:11:46.663521 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO dbcounter [None req-a86fa20a-9352-431e-a1d1-cd549f0e8b72 None None] Registered counter for database nova_cell1 Sep 21 12:11:46.672576 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG oslo_db.sqlalchemy.engines [None req-a86fa20a-9352-431e-a1d1-cd549f0e8b72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105419) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 12:11:46.676088 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG oslo_db.sqlalchemy.engines [None req-a86fa20a-9352-431e-a1d1-cd549f0e8b72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105419) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 12:11:46.683356 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG dbcounter [-] [105419] Writer thread running {{(pid=105419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 12:11:46.691342 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.context [None req-ab4d4514-4b67-49a3-bd7f-7b2942a8006a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5e3c3fc2-6e53-4c4a-a73a-c41818930d93(cell1) {{(pid=105420) load_cells /opt/stack/nova/nova/context.py:464}} Sep 21 12:11:46.696138 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-ab4d4514-4b67-49a3-bd7f-7b2942a8006a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:11:46.696853 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-ab4d4514-4b67-49a3-bd7f-7b2942a8006a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:11:46.698708 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-ab4d4514-4b67-49a3-bd7f-7b2942a8006a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:11:46.699635 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-ab4d4514-4b67-49a3-bd7f-7b2942a8006a None None] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:11:46.700114 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-ab4d4514-4b67-49a3-bd7f-7b2942a8006a None None] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:11:46.702777 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-ab4d4514-4b67-49a3-bd7f-7b2942a8006a None None] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:11:46.704875 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO dbcounter [None req-ab4d4514-4b67-49a3-bd7f-7b2942a8006a None None] Registered counter for database nova_cell0 Sep 21 12:11:46.709310 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO dbcounter [None req-ab4d4514-4b67-49a3-bd7f-7b2942a8006a None None] Registered counter for database nova_cell1 Sep 21 12:11:46.718463 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG oslo_db.sqlalchemy.engines [None req-ab4d4514-4b67-49a3-bd7f-7b2942a8006a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105420) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 12:11:46.720258 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG oslo_db.sqlalchemy.engines [None req-ab4d4514-4b67-49a3-bd7f-7b2942a8006a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105420) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 12:11:46.727244 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writer thread running {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 12:11:46.727596 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writer thread running {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 12:11:46.842011 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG dbcounter [-] [105419] Writer thread running {{(pid=105419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 12:11:46.854553 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO dbcounter [None req-a86fa20a-9352-431e-a1d1-cd549f0e8b72 None None] Registered counter for database nova_cell0 Sep 21 12:11:46.864008 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG oslo_db.sqlalchemy.engines [None req-a86fa20a-9352-431e-a1d1-cd549f0e8b72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105419) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 12:11:46.869337 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG dbcounter [-] [105419] Writer thread running {{(pid=105419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 12:11:46.887974 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO dbcounter [None req-ab4d4514-4b67-49a3-bd7f-7b2942a8006a None None] Registered counter for database nova_cell0 Sep 21 12:11:46.898265 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG oslo_db.sqlalchemy.engines [None req-ab4d4514-4b67-49a3-bd7f-7b2942a8006a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105420) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 12:11:46.903697 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writer thread running {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 12:11:47.222922 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: WARNING keystonemiddleware.auth_token [None req-a86fa20a-9352-431e-a1d1-cd549f0e8b72 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 21 12:11:47.230173 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: WARNING keystonemiddleware.auth_token [None req-a86fa20a-9352-431e-a1d1-cd549f0e8b72 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 21 12:11:47.244680 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: WARNING keystonemiddleware.auth_token [None req-ab4d4514-4b67-49a3-bd7f-7b2942a8006a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 21 12:11:47.252659 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: WARNING keystonemiddleware.auth_token [None req-ab4d4514-4b67-49a3-bd7f-7b2942a8006a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 21 12:11:47.576017 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: WARNING keystonemiddleware.auth_token [None req-a86fa20a-9352-431e-a1d1-cd549f0e8b72 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 21 12:11:47.582112 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: WARNING keystonemiddleware.auth_token [None req-a86fa20a-9352-431e-a1d1-cd549f0e8b72 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 21 12:11:47.587469 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f3a05159c0 pid: 105419 (default app) Sep 21 12:11:47.589824 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-a86fa20a-9352-431e-a1d1-cd549f0e8b72 None None] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:11:47.591007 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-a86fa20a-9352-431e-a1d1-cd549f0e8b72 None None] 10.222.0.71 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001738 Sep 21 12:11:47.591796 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 1/1] 10.222.0.71 () {50 vars in 788 bytes} [Wed Sep 21 12:11:47 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:11:47.609119 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: WARNING keystonemiddleware.auth_token [None req-ab4d4514-4b67-49a3-bd7f-7b2942a8006a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 21 12:11:47.615574 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: WARNING keystonemiddleware.auth_token [None req-ab4d4514-4b67-49a3-bd7f-7b2942a8006a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 21 12:11:47.620557 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f3a05159c0 pid: 105420 (default app) Sep 21 12:13:09.882970 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-a86fa20a-9352-431e-a1d1-cd549f0e8b72 None None] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:13:09.884739 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-a86fa20a-9352-431e-a1d1-cd549f0e8b72 None None] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002197 Sep 21 12:13:09.885249 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 2/2] 10.222.0.71 () {54 vars in 931 bytes} [Wed Sep 21 12:13:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 12:13:09.898193 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writing DB stats nova_api:SELECT=3 {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:09.899413 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writing DB stats nova_cell1:SELECT=3 {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:09.901017 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writing DB stats nova_cell0:SELECT=3 {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:09.902153 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writing DB stats nova_cell0:SELECT=3 {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:10.839222 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-69b2848a-53e7-412f-833b-47eb9d2e9d90 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:13:10.871908 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-69b2848a-53e7-412f-833b-47eb9d2e9d90 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.979273 Sep 21 12:13:10.875015 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 1/3] 10.222.0.71 () {60 vars in 1292 bytes} [Wed Sep 21 12:13:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:13:13.514946 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-a86fa20a-9352-431e-a1d1-cd549f0e8b72 None None] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:13:13.516000 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-a86fa20a-9352-431e-a1d1-cd549f0e8b72 None None] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Sep 21 12:13:13.516615 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 3/4] 10.222.0.71 () {54 vars in 931 bytes} [Wed Sep 21 12:13:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:13:13.994033 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-7e6a6680-090e-4578-8fb5-1455a5d95eec admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "rxtx_factor": 1.0, "swap": 0, "name": "cirros256", "id": "c1", "disk": 1, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:13:14.044858 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-7e6a6680-090e-4578-8fb5-1455a5d95eec admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.522336 Sep 21 12:13:14.045419 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 2/5] 10.222.0.71 () {64 vars in 1283 bytes} [Wed Sep 21 12:13:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 12:13:14.059432 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG dbcounter [-] [105419] Writing DB stats nova_api:SELECT=3 {{(pid=105419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:14.060323 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG dbcounter [-] [105419] Writing DB stats nova_cell0:SELECT=3 {{(pid=105419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:14.062346 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG dbcounter [-] [105419] Writing DB stats nova_cell1:SELECT=3 {{(pid=105419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:14.063142 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG dbcounter [-] [105419] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:14.271978 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-7ed407f4-0c21-4960-9809-ab4fdb3f404c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:13:14.346551 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-7ed407f4-0c21-4960-9809-ab4fdb3f404c admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.292631 Sep 21 12:13:14.347142 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 4/6] 10.222.0.71 () {64 vars in 1336 bytes} [Wed Sep 21 12:13:14 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:13:16.978466 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-7e6a6680-090e-4578-8fb5-1455a5d95eec admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:13:16.979475 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-7e6a6680-090e-4578-8fb5-1455a5d95eec admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001978 Sep 21 12:13:16.979904 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 3/7] 10.222.0.71 () {54 vars in 931 bytes} [Wed Sep 21 12:13:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:13:17.664547 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-cd4476b2-77ec-4090-9ff1-61f09a812b54 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "swap": 0, "disk": 5, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:13:17.707637 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-cd4476b2-77ec-4090-9ff1-61f09a812b54 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.721478 Sep 21 12:13:17.711813 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 5/8] 10.222.0.71 () {64 vars in 1283 bytes} [Wed Sep 21 12:13:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 12:13:17.720810 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-9fb91ec4-941a-4131-af6e-94b98cfc9be2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:13:17.770137 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-9fb91ec4-941a-4131-af6e-94b98cfc9be2 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052910 Sep 21 12:13:17.776054 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 4/9] 10.222.0.71 () {64 vars in 1336 bytes} [Wed Sep 21 12:13:17 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:13:20.409680 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-cd4476b2-77ec-4090-9ff1-61f09a812b54 admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:13:20.410736 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-cd4476b2-77ec-4090-9ff1-61f09a812b54 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Sep 21 12:13:20.411162 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 6/10] 10.222.0.71 () {54 vars in 931 bytes} [Wed Sep 21 12:13:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:13:20.837143 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-4f4194f4-5a52-4335-be2f-5aefdae921c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "swap": 0, "disk": 10, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d2", "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:13:20.857364 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-4f4194f4-5a52-4335-be2f-5aefdae921c0 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.438604 Sep 21 12:13:20.858172 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 5/11] 10.222.0.71 () {64 vars in 1283 bytes} [Wed Sep 21 12:13:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 12:13:20.870785 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-a8e92d83-58fe-461b-9d5e-2323a892d8cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:13:20.905077 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-a8e92d83-58fe-461b-9d5e-2323a892d8cd admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038498 Sep 21 12:13:20.905678 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 7/12] 10.222.0.71 () {64 vars in 1336 bytes} [Wed Sep 21 12:13:20 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:13:23.554360 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-4f4194f4-5a52-4335-be2f-5aefdae921c0 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:13:23.555293 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-4f4194f4-5a52-4335-be2f-5aefdae921c0 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 21 12:13:23.555730 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 6/13] 10.222.0.71 () {54 vars in 931 bytes} [Wed Sep 21 12:13:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:13:23.972410 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-1029533b-e96d-4e36-9c52-cb7cd7b58db3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 2048, "os-flavor-access:is_public": true, "name": "ds2G", "swap": 0, "id": "d3", "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:13:23.991852 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-1029533b-e96d-4e36-9c52-cb7cd7b58db3 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.429783 Sep 21 12:13:23.992504 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 8/14] 10.222.0.71 () {64 vars in 1283 bytes} [Wed Sep 21 12:13:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 12:13:24.005641 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-711e9975-9b0c-4d2c-93f7-189df35b5ed9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:13:24.034988 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-711e9975-9b0c-4d2c-93f7-189df35b5ed9 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032996 Sep 21 12:13:24.035909 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 7/15] 10.222.0.71 () {64 vars in 1336 bytes} [Wed Sep 21 12:13:24 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:13:26.753165 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-1029533b-e96d-4e36-9c52-cb7cd7b58db3 admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:13:26.754585 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-1029533b-e96d-4e36-9c52-cb7cd7b58db3 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002051 Sep 21 12:13:26.755096 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 9/16] 10.222.0.71 () {54 vars in 931 bytes} [Wed Sep 21 12:13:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:13:27.207260 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-aff2a288-d7d4-43e9-bec4-a4dcdf64655e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "name": "ds4G", "id": "d4", "ram": 4096, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:13:27.230658 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-aff2a288-d7d4-43e9-bec4-a4dcdf64655e admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.466806 Sep 21 12:13:27.231208 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 8/17] 10.222.0.71 () {64 vars in 1283 bytes} [Wed Sep 21 12:13:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 12:13:27.243554 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-22398ef1-ba50-48bb-8620-cbdc444ba619 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:13:27.268719 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-22398ef1-ba50-48bb-8620-cbdc444ba619 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029002 Sep 21 12:13:27.269304 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 10/18] 10.222.0.71 () {64 vars in 1336 bytes} [Wed Sep 21 12:13:27 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:13:29.915436 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-aff2a288-d7d4-43e9-bec4-a4dcdf64655e admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:13:29.916508 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-aff2a288-d7d4-43e9-bec4-a4dcdf64655e admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Sep 21 12:13:29.917023 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 9/19] 10.222.0.71 () {54 vars in 931 bytes} [Wed Sep 21 12:13:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:13:30.350111 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-0df2b8c6-8a54-4228-af28-b6c9f49517b4 admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:13:30.374945 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-0df2b8c6-8a54-4228-af28-b6c9f49517b4 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.451641 Sep 21 12:13:30.375410 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 11/20] 10.222.0.71 () {60 vars in 1292 bytes} [Wed Sep 21 12:13:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:13:33.031917 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-aff2a288-d7d4-43e9-bec4-a4dcdf64655e admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:13:33.032916 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-aff2a288-d7d4-43e9-bec4-a4dcdf64655e admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Sep 21 12:13:33.033324 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 10/21] 10.222.0.71 () {54 vars in 931 bytes} [Wed Sep 21 12:13:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:13:33.437704 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-e49535e9-5917-4d65-beca-cd59908ddd03 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "disk": 1, "name": "m1.tiny"}} {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:13:33.460059 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-e49535e9-5917-4d65-beca-cd59908ddd03 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.420405 Sep 21 12:13:33.460605 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 12/22] 10.222.0.71 () {64 vars in 1283 bytes} [Wed Sep 21 12:13:33 2022] POST /compute/v2.1/flavors => generated 402 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 12:13:33.473439 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-ca8933d9-5dfa-41bd-8cb6-ee270948769e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:13:33.500607 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-ca8933d9-5dfa-41bd-8cb6-ee270948769e admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030819 Sep 21 12:13:33.501183 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 11/23] 10.222.0.71 () {64 vars in 1333 bytes} [Wed Sep 21 12:13:33 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:13:36.127974 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-e49535e9-5917-4d65-beca-cd59908ddd03 admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:13:36.129033 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-e49535e9-5917-4d65-beca-cd59908ddd03 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Sep 21 12:13:36.129427 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 13/24] 10.222.0.71 () {54 vars in 931 bytes} [Wed Sep 21 12:13:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:13:36.573309 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-d62d1f89-a72a-44b1-af3e-d9a50bcb7d97 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "ram": 2048, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "swap": 0, "name": "m1.small", "rxtx_factor": 1.0}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:13:36.602037 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-d62d1f89-a72a-44b1-af3e-d9a50bcb7d97 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.465484 Sep 21 12:13:36.602610 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 12/25] 10.222.0.71 () {64 vars in 1283 bytes} [Wed Sep 21 12:13:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 21 12:13:36.614871 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-0ad7ae53-1e51-46a3-ac1b-91c2eed7ead8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:13:36.643128 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-0ad7ae53-1e51-46a3-ac1b-91c2eed7ead8 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032211 Sep 21 12:13:36.643911 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 14/26] 10.222.0.71 () {64 vars in 1333 bytes} [Wed Sep 21 12:13:36 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:13:39.286827 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-d62d1f89-a72a-44b1-af3e-d9a50bcb7d97 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:13:39.288512 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-d62d1f89-a72a-44b1-af3e-d9a50bcb7d97 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002178 Sep 21 12:13:39.288965 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 13/27] 10.222.0.71 () {54 vars in 931 bytes} [Wed Sep 21 12:13:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:13:39.811211 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-6674cc79-601b-4890-8eb4-9616c8755976 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "disk": 40, "name": "m1.medium", "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:13:39.833291 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-6674cc79-601b-4890-8eb4-9616c8755976 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.537927 Sep 21 12:13:39.834160 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 15/28] 10.222.0.71 () {64 vars in 1283 bytes} [Wed Sep 21 12:13:39 2022] POST /compute/v2.1/flavors => generated 406 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 12:13:39.850718 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-82bb67da-2f89-4707-a515-e7f9127aeb7b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:13:39.875780 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-82bb67da-2f89-4707-a515-e7f9127aeb7b admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028626 Sep 21 12:13:39.876483 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 14/29] 10.222.0.71 () {64 vars in 1333 bytes} [Wed Sep 21 12:13:39 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:13:42.610967 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-6674cc79-601b-4890-8eb4-9616c8755976 admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:13:42.611923 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-6674cc79-601b-4890-8eb4-9616c8755976 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Sep 21 12:13:42.612321 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 16/30] 10.222.0.71 () {54 vars in 931 bytes} [Wed Sep 21 12:13:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:13:43.062671 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-5f807fed-e430-4f9e-b20a-125c411be508 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "disk": 80, "vcpus": 4, "rxtx_factor": 1.0, "ram": 8192, "name": "m1.large", "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:13:43.068453 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:43.088054 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-5f807fed-e430-4f9e-b20a-125c411be508 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.468793 Sep 21 12:13:43.088829 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 15/31] 10.222.0.71 () {64 vars in 1283 bytes} [Wed Sep 21 12:13:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 21 12:13:43.100608 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-76e0e060-d43e-49c1-9f71-69bd80b5f9cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:13:43.129027 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-76e0e060-d43e-49c1-9f71-69bd80b5f9cd admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032022 Sep 21 12:13:43.129946 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 17/32] 10.222.0.71 () {64 vars in 1333 bytes} [Wed Sep 21 12:13:43 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:13:45.775008 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-5f807fed-e430-4f9e-b20a-125c411be508 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:13:45.776063 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-5f807fed-e430-4f9e-b20a-125c411be508 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 21 12:13:45.776744 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 16/33] 10.222.0.71 () {54 vars in 931 bytes} [Wed Sep 21 12:13:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:13:46.243150 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-237c14a3-0638-4f47-8b85-53a3acf74930 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "5", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 8, "disk": 160, "swap": 0, "name": "m1.xlarge"}} {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:13:46.249677 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG dbcounter [-] [105419] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:46.264918 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-237c14a3-0638-4f47-8b85-53a3acf74930 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.481289 Sep 21 12:13:46.265674 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 18/34] 10.222.0.71 () {64 vars in 1283 bytes} [Wed Sep 21 12:13:45 2022] POST /compute/v2.1/flavors => generated 408 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 12:13:46.279592 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-ff56ad96-ec81-4a7a-82d6-3899d1b8c89b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:13:46.304630 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-ff56ad96-ec81-4a7a-82d6-3899d1b8c89b admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030147 Sep 21 12:13:46.320264 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 17/35] 10.222.0.71 () {64 vars in 1333 bytes} [Wed Sep 21 12:13:46 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:14:02.759534 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-237c14a3-0638-4f47-8b85-53a3acf74930 admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:14:02.760608 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-237c14a3-0638-4f47-8b85-53a3acf74930 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002135 Sep 21 12:14:02.761012 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 19/36] 10.222.0.71 () {54 vars in 931 bytes} [Wed Sep 21 12:14:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:14:02.771646 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:03.154595 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-801d4965-bab6-4308-9e3f-45673bfbff92 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:14:03.176944 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-801d4965-bab6-4308-9e3f-45673bfbff92 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.409612 Sep 21 12:14:03.177500 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 18/37] 10.222.0.71 () {60 vars in 1292 bytes} [Wed Sep 21 12:14:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:14:04.477151 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-237c14a3-0638-4f47-8b85-53a3acf74930 admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:14:04.478760 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-237c14a3-0638-4f47-8b85-53a3acf74930 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002028 Sep 21 12:14:04.479152 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 20/38] 10.222.0.71 () {56 vars in 1074 bytes} [Wed Sep 21 12:14:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:14:05.007560 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-e834998b-4fe4-4220-ac48-cd0680895cf4 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:14:05.013588 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.wsgi [None req-e834998b-4fe4-4220-ac48-cd0680895cf4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 21 12:14:05.016859 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-e834998b-4fe4-4220-ac48-cd0680895cf4 admin admin] Request method failure captured: Sep 21 12:14:05.016859 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 21 12:14:05.016859 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: Accept: application/json Sep 21 12:14:05.016859 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: Accept-Encoding: gzip, deflate Sep 21 12:14:05.016859 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: Connection: keep-alive Sep 21 12:14:05.016859 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: Content-Length: 0 Sep 21 12:14:05.016859 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: Host: 10.222.0.71 Sep 21 12:14:05.016859 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: Openstack-Api-Version: compute 2.92 Sep 21 12:14:05.016859 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: Openstack-System-Scope: None Sep 21 12:14:05.016859 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: User-Agent: python-novaclient Sep 21 12:14:05.016859 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Auth-Token: gAAAAABjKwAMtP-KHTgg6wlZchBW3Jj-S_kKg_bkde20CGVT6osUdot8pseoCv9Quo1gIwnL6Xl6Z-vux0Qh3Ff8ufXsSXidei9U78J5hdUg-1f4H5sDMfLt06Uewo1qNlwXusccGWTVXuQFVwqwnBVOG8-0RoB8h9Eru2dScwe9wqokg-mGpqM Sep 21 12:14:05.016859 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Domain-Id: None Sep 21 12:14:05.016859 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Domain-Name: None Sep 21 12:14:05.016859 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Identity-Status: Confirmed Sep 21 12:14:05.016859 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Is-Admin-Project: True Sep 21 12:14:05.016859 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Openstack-Nova-Api-Version: 2.92 Sep 21 12:14:05.016859 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Project-Domain-Id: default Sep 21 12:14:05.016859 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Project-Domain-Name: Default Sep 21 12:14:05.016859 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Project-Id: 5d4deb4c3b0e444f92c029c040b5603c Sep 21 12:14:05.016859 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Project-Name: admin Sep 21 12:14:05.016859 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Role: reader,admin,member Sep 21 12:14:05.016859 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Roles: reader,admin,member Sep 21 12:14:05.018418 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/5d4deb4c3b0e444f92c029c040b5603c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/5d4deb4c3b0e444f92c029c040b5603c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_5d4deb4c3b0e444f92c029c040b5603c", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/5d4deb4c3b0e444f92c029c040b5603c"}]}] Sep 21 12:14:05.018418 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Tenant: admin Sep 21 12:14:05.018418 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Tenant-Id: 5d4deb4c3b0e444f92c029c040b5603c Sep 21 12:14:05.018418 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Tenant-Name: admin Sep 21 12:14:05.018418 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-User: admin Sep 21 12:14:05.018418 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-User-Domain-Id: default Sep 21 12:14:05.018418 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-User-Domain-Name: Default Sep 21 12:14:05.018418 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-User-Id: 661f5d19be0f436ca14e6e9b440ca709 Sep 21 12:14:05.018418 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-User-Name: admin Sep 21 12:14:05.018418 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: method: > Sep 21 12:14:05.018418 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: exception: Flavor 42 could not be found. Sep 21 12:14:05.018418 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: action_args: {'id': '42'} Sep 21 12:14:05.018418 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:14:05.018418 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:14:05.019262 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 21 12:14:05.019262 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 21 12:14:05.019262 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 21 12:14:05.019262 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 21 12:14:05.019262 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 21 12:14:05.019262 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 21 12:14:05.019262 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 21 12:14:05.019262 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 21 12:14:05.019262 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 21 12:14:05.019262 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:14:05.019262 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 21 12:14:05.019262 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 21 12:14:05.019262 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 21 12:14:05.019262 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 21 12:14:05.019262 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:14:05.019262 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 21 12:14:05.019262 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:14:05.019262 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:14:05.019262 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:14:05.020400 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:14:05.020400 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:14:05.020400 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:14:05.020400 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:14:05.020400 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 21 12:14:05.020400 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:14:05.020400 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 21 12:14:05.020400 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 21 12:14:05.020400 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:14:05.020400 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 21 12:14:05.020400 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:14:05.020400 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:14:05.020400 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:14:05.020400 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:14:05.020400 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:14:05.020400 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 21 12:14:05.020400 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 21 12:14:05.020400 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-e834998b-4fe4-4220-ac48-cd0680895cf4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105420) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:14:05.021674 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-e834998b-4fe4-4220-ac48-cd0680895cf4 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.402853 Sep 21 12:14:05.021674 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 19/39] 10.222.0.71 () {60 vars in 1190 bytes} [Wed Sep 21 12:14:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 21 12:14:05.028535 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-8f60851c-b751-47f0-97c4-d4682edd7767 admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:14:05.051369 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-8f60851c-b751-47f0-97c4-d4682edd7767 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026481 Sep 21 12:14:05.052076 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 21/40] 10.222.0.71 () {60 vars in 1210 bytes} [Wed Sep 21 12:14:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:14:05.064485 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-52ec3043-fb7a-4b06-a658-242a5909ca28 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:14:05.087281 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-52ec3043-fb7a-4b06-a658-242a5909ca28 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027324 Sep 21 12:14:05.088028 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 20/41] 10.222.0.71 () {60 vars in 1210 bytes} [Wed Sep 21 12:14:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:14:05.097950 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-5d76c58d-0c28-43d3-bf9d-fd1cf6aa972b admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:14:05.103381 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.wsgi [None req-5d76c58d-0c28-43d3-bf9d-fd1cf6aa972b admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 21 12:14:05.106692 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-5d76c58d-0c28-43d3-bf9d-fd1cf6aa972b admin admin] Request method failure captured: Sep 21 12:14:05.106692 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 21 12:14:05.106692 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: Accept: application/json Sep 21 12:14:05.106692 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: Accept-Encoding: gzip, deflate Sep 21 12:14:05.106692 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: Connection: keep-alive Sep 21 12:14:05.106692 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: Content-Length: 0 Sep 21 12:14:05.106692 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: Host: 10.222.0.71 Sep 21 12:14:05.106692 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: Openstack-Api-Version: compute 2.92 Sep 21 12:14:05.106692 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: Openstack-System-Scope: None Sep 21 12:14:05.106692 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: User-Agent: python-novaclient Sep 21 12:14:05.106692 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Auth-Token: gAAAAABjKwAMtP-KHTgg6wlZchBW3Jj-S_kKg_bkde20CGVT6osUdot8pseoCv9Quo1gIwnL6Xl6Z-vux0Qh3Ff8ufXsSXidei9U78J5hdUg-1f4H5sDMfLt06Uewo1qNlwXusccGWTVXuQFVwqwnBVOG8-0RoB8h9Eru2dScwe9wqokg-mGpqM Sep 21 12:14:05.106692 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Domain-Id: None Sep 21 12:14:05.106692 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Domain-Name: None Sep 21 12:14:05.106692 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Identity-Status: Confirmed Sep 21 12:14:05.106692 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Is-Admin-Project: True Sep 21 12:14:05.106692 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Openstack-Nova-Api-Version: 2.92 Sep 21 12:14:05.106692 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Project-Domain-Id: default Sep 21 12:14:05.106692 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Project-Domain-Name: Default Sep 21 12:14:05.106692 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Project-Id: 5d4deb4c3b0e444f92c029c040b5603c Sep 21 12:14:05.106692 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Project-Name: admin Sep 21 12:14:05.106692 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Role: reader,admin,member Sep 21 12:14:05.106692 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Roles: reader,admin,member Sep 21 12:14:05.108179 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/5d4deb4c3b0e444f92c029c040b5603c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/5d4deb4c3b0e444f92c029c040b5603c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_5d4deb4c3b0e444f92c029c040b5603c", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/5d4deb4c3b0e444f92c029c040b5603c"}]}] Sep 21 12:14:05.108179 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Tenant: admin Sep 21 12:14:05.108179 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Tenant-Id: 5d4deb4c3b0e444f92c029c040b5603c Sep 21 12:14:05.108179 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Tenant-Name: admin Sep 21 12:14:05.108179 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-User: admin Sep 21 12:14:05.108179 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-User-Domain-Id: default Sep 21 12:14:05.108179 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-User-Domain-Name: Default Sep 21 12:14:05.108179 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-User-Id: 661f5d19be0f436ca14e6e9b440ca709 Sep 21 12:14:05.108179 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-User-Name: admin Sep 21 12:14:05.108179 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: method: > Sep 21 12:14:05.108179 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: exception: Flavor 42 could not be found. Sep 21 12:14:05.108179 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: action_args: {'id': '42'} Sep 21 12:14:05.108179 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:14:05.108179 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:14:05.109131 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 21 12:14:05.109131 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 21 12:14:05.109131 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 21 12:14:05.109131 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 21 12:14:05.109131 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 21 12:14:05.109131 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 21 12:14:05.109131 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 21 12:14:05.109131 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 21 12:14:05.109131 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 21 12:14:05.109131 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:14:05.109131 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 21 12:14:05.109131 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 21 12:14:05.109131 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 21 12:14:05.109131 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Sep 21 12:14:05.109131 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:14:05.109131 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Sep 21 12:14:05.109131 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:14:05.109131 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:14:05.109131 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:14:05.110226 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:14:05.110226 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:14:05.110226 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:14:05.110226 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:14:05.110226 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 21 12:14:05.110226 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:14:05.110226 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 21 12:14:05.110226 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Sep 21 12:14:05.110226 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:14:05.110226 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Sep 21 12:14:05.110226 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:14:05.110226 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:14:05.110226 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:14:05.110226 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:14:05.110226 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:14:05.110226 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 21 12:14:05.110226 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Sep 21 12:14:05.110226 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-5d76c58d-0c28-43d3-bf9d-fd1cf6aa972b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105419) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:14:05.111187 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-5d76c58d-0c28-43d3-bf9d-fd1cf6aa972b admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013757 Sep 21 12:14:05.111187 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 22/42] 10.222.0.71 () {60 vars in 1190 bytes} [Wed Sep 21 12:14:05 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 21 12:14:06.337052 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-52ec3043-fb7a-4b06-a658-242a5909ca28 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:14:06.338062 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-52ec3043-fb7a-4b06-a658-242a5909ca28 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002209 Sep 21 12:14:06.339916 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 21/43] 10.222.0.71 () {56 vars in 1074 bytes} [Wed Sep 21 12:14:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:14:06.867483 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-0325847d-175f-4014-9599-f3b197b00147 admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:14:06.872683 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.wsgi [None req-0325847d-175f-4014-9599-f3b197b00147 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 21 12:14:06.874203 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-0325847d-175f-4014-9599-f3b197b00147 admin admin] Request method failure captured: Sep 21 12:14:06.874203 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 21 12:14:06.874203 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: Accept: application/json Sep 21 12:14:06.874203 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: Accept-Encoding: gzip, deflate Sep 21 12:14:06.874203 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: Connection: keep-alive Sep 21 12:14:06.874203 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: Content-Length: 0 Sep 21 12:14:06.874203 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: Host: 10.222.0.71 Sep 21 12:14:06.874203 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: Openstack-Api-Version: compute 2.92 Sep 21 12:14:06.874203 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: Openstack-System-Scope: None Sep 21 12:14:06.874203 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: User-Agent: python-novaclient Sep 21 12:14:06.874203 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Auth-Token: gAAAAABjKwAOD9cmndRg_EvMhXO8GVNmWhzr9wQjPyNEwxP8SuEn-8_kcwX2Xzvo-u8o06ZVjsLCHDDB0aFlM-ieeucCq8FoHvQkDU4HrruzRmZ2nrFtE2_flG_i3I-rmeEykbgg941ATfo_2QNoyWLaFBwoEruhR9CCa7qTwrGz8NM6f5IUCBw Sep 21 12:14:06.874203 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Domain-Id: None Sep 21 12:14:06.874203 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Domain-Name: None Sep 21 12:14:06.874203 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Identity-Status: Confirmed Sep 21 12:14:06.874203 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Is-Admin-Project: True Sep 21 12:14:06.874203 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Openstack-Nova-Api-Version: 2.92 Sep 21 12:14:06.874203 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Project-Domain-Id: default Sep 21 12:14:06.874203 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Project-Domain-Name: Default Sep 21 12:14:06.874203 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Project-Id: 5d4deb4c3b0e444f92c029c040b5603c Sep 21 12:14:06.874203 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Project-Name: admin Sep 21 12:14:06.874203 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Role: reader,admin,member Sep 21 12:14:06.874203 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Roles: reader,admin,member Sep 21 12:14:06.875723 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/5d4deb4c3b0e444f92c029c040b5603c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/5d4deb4c3b0e444f92c029c040b5603c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_5d4deb4c3b0e444f92c029c040b5603c", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/5d4deb4c3b0e444f92c029c040b5603c"}]}] Sep 21 12:14:06.875723 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Tenant: admin Sep 21 12:14:06.875723 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Tenant-Id: 5d4deb4c3b0e444f92c029c040b5603c Sep 21 12:14:06.875723 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Tenant-Name: admin Sep 21 12:14:06.875723 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-User: admin Sep 21 12:14:06.875723 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-User-Domain-Id: default Sep 21 12:14:06.875723 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-User-Domain-Name: Default Sep 21 12:14:06.875723 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-User-Id: 661f5d19be0f436ca14e6e9b440ca709 Sep 21 12:14:06.875723 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-User-Name: admin Sep 21 12:14:06.875723 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: method: > Sep 21 12:14:06.875723 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: exception: Flavor 84 could not be found. Sep 21 12:14:06.875723 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: action_args: {'id': '84'} Sep 21 12:14:06.875723 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:14:06.875723 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:14:06.876562 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 21 12:14:06.876562 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 21 12:14:06.876562 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 21 12:14:06.876562 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 21 12:14:06.876562 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 21 12:14:06.876562 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 21 12:14:06.876562 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 21 12:14:06.876562 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 21 12:14:06.876562 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 21 12:14:06.876562 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:14:06.876562 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 21 12:14:06.876562 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 21 12:14:06.876562 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 21 12:14:06.876562 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Sep 21 12:14:06.876562 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:14:06.876562 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Sep 21 12:14:06.876562 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:14:06.876562 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:14:06.876562 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:14:06.877895 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:14:06.877895 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:14:06.877895 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:14:06.877895 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:14:06.877895 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 21 12:14:06.877895 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:14:06.877895 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 21 12:14:06.877895 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Sep 21 12:14:06.877895 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:14:06.877895 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Sep 21 12:14:06.877895 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:14:06.877895 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:14:06.877895 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:14:06.877895 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:14:06.877895 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:14:06.877895 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 21 12:14:06.877895 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Sep 21 12:14:06.877895 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-0325847d-175f-4014-9599-f3b197b00147 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105419) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:14:06.878970 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-0325847d-175f-4014-9599-f3b197b00147 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.398427 Sep 21 12:14:06.878970 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 23/44] 10.222.0.71 () {60 vars in 1190 bytes} [Wed Sep 21 12:14:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 21 12:14:06.886521 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-60cf3869-6d02-43d6-9ed0-6082c107a09d admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:14:06.902826 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-60cf3869-6d02-43d6-9ed0-6082c107a09d admin admin] 10.222.0.71 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020642 Sep 21 12:14:06.903379 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 22/45] 10.222.0.71 () {60 vars in 1210 bytes} [Wed Sep 21 12:14:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:14:06.913160 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-7576e0c0-321d-4311-9c84-0d32c01d04b9 admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:14:06.929269 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-7576e0c0-321d-4311-9c84-0d32c01d04b9 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019708 Sep 21 12:14:06.929809 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 24/46] 10.222.0.71 () {60 vars in 1210 bytes} [Wed Sep 21 12:14:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:14:06.939371 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-8d08ec66-779e-4544-8304-2f70f8c62077 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:14:06.944465 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.wsgi [None req-8d08ec66-779e-4544-8304-2f70f8c62077 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 21 12:14:06.946511 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-8d08ec66-779e-4544-8304-2f70f8c62077 admin admin] Request method failure captured: Sep 21 12:14:06.946511 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 21 12:14:06.946511 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: Accept: application/json Sep 21 12:14:06.946511 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: Accept-Encoding: gzip, deflate Sep 21 12:14:06.946511 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: Connection: keep-alive Sep 21 12:14:06.946511 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: Content-Length: 0 Sep 21 12:14:06.946511 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: Host: 10.222.0.71 Sep 21 12:14:06.946511 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: Openstack-Api-Version: compute 2.92 Sep 21 12:14:06.946511 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: Openstack-System-Scope: None Sep 21 12:14:06.946511 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: User-Agent: python-novaclient Sep 21 12:14:06.946511 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Auth-Token: gAAAAABjKwAOD9cmndRg_EvMhXO8GVNmWhzr9wQjPyNEwxP8SuEn-8_kcwX2Xzvo-u8o06ZVjsLCHDDB0aFlM-ieeucCq8FoHvQkDU4HrruzRmZ2nrFtE2_flG_i3I-rmeEykbgg941ATfo_2QNoyWLaFBwoEruhR9CCa7qTwrGz8NM6f5IUCBw Sep 21 12:14:06.946511 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Domain-Id: None Sep 21 12:14:06.946511 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Domain-Name: None Sep 21 12:14:06.946511 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Identity-Status: Confirmed Sep 21 12:14:06.946511 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Is-Admin-Project: True Sep 21 12:14:06.946511 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Openstack-Nova-Api-Version: 2.92 Sep 21 12:14:06.946511 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Project-Domain-Id: default Sep 21 12:14:06.946511 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Project-Domain-Name: Default Sep 21 12:14:06.946511 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Project-Id: 5d4deb4c3b0e444f92c029c040b5603c Sep 21 12:14:06.946511 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Project-Name: admin Sep 21 12:14:06.946511 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Role: reader,admin,member Sep 21 12:14:06.946511 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Roles: reader,admin,member Sep 21 12:14:06.948080 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/5d4deb4c3b0e444f92c029c040b5603c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/5d4deb4c3b0e444f92c029c040b5603c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_5d4deb4c3b0e444f92c029c040b5603c", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/5d4deb4c3b0e444f92c029c040b5603c"}]}] Sep 21 12:14:06.948080 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Tenant: admin Sep 21 12:14:06.948080 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Tenant-Id: 5d4deb4c3b0e444f92c029c040b5603c Sep 21 12:14:06.948080 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Tenant-Name: admin Sep 21 12:14:06.948080 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-User: admin Sep 21 12:14:06.948080 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-User-Domain-Id: default Sep 21 12:14:06.948080 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-User-Domain-Name: Default Sep 21 12:14:06.948080 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-User-Id: 661f5d19be0f436ca14e6e9b440ca709 Sep 21 12:14:06.948080 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-User-Name: admin Sep 21 12:14:06.948080 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: method: > Sep 21 12:14:06.948080 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: exception: Flavor 84 could not be found. Sep 21 12:14:06.948080 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: action_args: {'id': '84'} Sep 21 12:14:06.948080 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:14:06.948080 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:14:06.949036 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 21 12:14:06.949036 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 21 12:14:06.949036 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 21 12:14:06.949036 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 21 12:14:06.949036 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 21 12:14:06.949036 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 21 12:14:06.949036 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 21 12:14:06.949036 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 21 12:14:06.949036 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 21 12:14:06.949036 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:14:06.949036 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 21 12:14:06.949036 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 21 12:14:06.949036 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 21 12:14:06.949036 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 21 12:14:06.949036 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:14:06.949036 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 21 12:14:06.949036 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:14:06.949036 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:14:06.949036 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:14:06.950321 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:14:06.950321 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:14:06.950321 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:14:06.950321 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:14:06.950321 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 21 12:14:06.950321 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:14:06.950321 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 21 12:14:06.950321 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 21 12:14:06.950321 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:14:06.950321 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 21 12:14:06.950321 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:14:06.950321 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:14:06.950321 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:14:06.950321 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:14:06.950321 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:14:06.950321 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 21 12:14:06.950321 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 21 12:14:06.950321 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-8d08ec66-779e-4544-8304-2f70f8c62077 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105420) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:14:06.951509 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-8d08ec66-779e-4544-8304-2f70f8c62077 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012254 Sep 21 12:14:06.951509 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 23/47] 10.222.0.71 () {60 vars in 1190 bytes} [Wed Sep 21 12:14:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 21 12:14:08.155299 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-7576e0c0-321d-4311-9c84-0d32c01d04b9 admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:14:08.156322 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-7576e0c0-321d-4311-9c84-0d32c01d04b9 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Sep 21 12:14:08.156707 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 25/48] 10.222.0.71 () {56 vars in 1074 bytes} [Wed Sep 21 12:14:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:14:08.684619 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-0934076d-3539-4ddd-b9ea-70e439c41f68 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:14:08.690486 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.wsgi [None req-0934076d-3539-4ddd-b9ea-70e439c41f68 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 21 12:14:08.692046 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-0934076d-3539-4ddd-b9ea-70e439c41f68 admin admin] Request method failure captured: Sep 21 12:14:08.692046 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 21 12:14:08.692046 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: Accept: application/json Sep 21 12:14:08.692046 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: Accept-Encoding: gzip, deflate Sep 21 12:14:08.692046 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: Connection: keep-alive Sep 21 12:14:08.692046 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: Content-Length: 0 Sep 21 12:14:08.692046 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: Host: 10.222.0.71 Sep 21 12:14:08.692046 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: Openstack-Api-Version: compute 2.92 Sep 21 12:14:08.692046 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: Openstack-System-Scope: None Sep 21 12:14:08.692046 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: User-Agent: python-novaclient Sep 21 12:14:08.692046 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Auth-Token: gAAAAABjKwAQCHqK5slq4U8sujqLhJScTWX58-fvg1CvH1lSisKhQTFKNOCsJqNzAmmgZHnyfcUiU3o7iLhY7WAqJuc-2LCZMP91wj7ACY2TEDyszI1nk9C50ccBl23JTxl3uE6i9nb_AjcCfJY77Dva1K0_ki9-OSsdtXjQ8vnwIsuS1BZBFKk Sep 21 12:14:08.692046 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Domain-Id: None Sep 21 12:14:08.692046 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Domain-Name: None Sep 21 12:14:08.692046 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Identity-Status: Confirmed Sep 21 12:14:08.692046 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Is-Admin-Project: True Sep 21 12:14:08.692046 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Openstack-Nova-Api-Version: 2.92 Sep 21 12:14:08.692046 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Project-Domain-Id: default Sep 21 12:14:08.692046 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Project-Domain-Name: Default Sep 21 12:14:08.692046 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Project-Id: 5d4deb4c3b0e444f92c029c040b5603c Sep 21 12:14:08.692046 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Project-Name: admin Sep 21 12:14:08.692046 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Role: reader,admin,member Sep 21 12:14:08.692046 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Roles: reader,admin,member Sep 21 12:14:08.693589 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/5d4deb4c3b0e444f92c029c040b5603c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/5d4deb4c3b0e444f92c029c040b5603c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_5d4deb4c3b0e444f92c029c040b5603c", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/5d4deb4c3b0e444f92c029c040b5603c"}]}] Sep 21 12:14:08.693589 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Tenant: admin Sep 21 12:14:08.693589 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Tenant-Id: 5d4deb4c3b0e444f92c029c040b5603c Sep 21 12:14:08.693589 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-Tenant-Name: admin Sep 21 12:14:08.693589 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-User: admin Sep 21 12:14:08.693589 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-User-Domain-Id: default Sep 21 12:14:08.693589 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-User-Domain-Name: Default Sep 21 12:14:08.693589 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-User-Id: 661f5d19be0f436ca14e6e9b440ca709 Sep 21 12:14:08.693589 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: X-User-Name: admin Sep 21 12:14:08.693589 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: method: > Sep 21 12:14:08.693589 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: exception: Flavor 451 could not be found. Sep 21 12:14:08.693589 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: action_args: {'id': '451'} Sep 21 12:14:08.693589 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:14:08.693589 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:14:08.694499 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 21 12:14:08.694499 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 21 12:14:08.694499 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 21 12:14:08.694499 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 21 12:14:08.694499 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 21 12:14:08.694499 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 21 12:14:08.694499 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 21 12:14:08.694499 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 21 12:14:08.694499 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 21 12:14:08.694499 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:14:08.694499 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 21 12:14:08.694499 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 21 12:14:08.694499 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 21 12:14:08.694499 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 21 12:14:08.694499 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:14:08.694499 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 21 12:14:08.694499 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:14:08.694499 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:14:08.694499 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:14:08.695932 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:14:08.695932 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:14:08.695932 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:14:08.695932 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:14:08.695932 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 21 12:14:08.695932 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:14:08.695932 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 21 12:14:08.695932 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 21 12:14:08.695932 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:14:08.695932 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 21 12:14:08.695932 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:14:08.695932 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:14:08.695932 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:14:08.695932 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:14:08.695932 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:14:08.695932 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 21 12:14:08.695932 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 21 12:14:08.695932 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-0934076d-3539-4ddd-b9ea-70e439c41f68 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105420) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:14:08.697677 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-0934076d-3539-4ddd-b9ea-70e439c41f68 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.399305 Sep 21 12:14:08.697677 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 24/49] 10.222.0.71 () {60 vars in 1193 bytes} [Wed Sep 21 12:14:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 21 12:14:08.704065 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-5090b020-5d01-43c1-8f9a-459ec4003ddc admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:14:08.718914 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-5090b020-5d01-43c1-8f9a-459ec4003ddc admin admin] 10.222.0.71 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018569 Sep 21 12:14:08.719440 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 26/50] 10.222.0.71 () {60 vars in 1210 bytes} [Wed Sep 21 12:14:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:14:08.728894 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-3fc2b4a8-3fcd-4dd7-ae63-29af1052145a admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:14:08.745009 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-3fc2b4a8-3fcd-4dd7-ae63-29af1052145a admin admin] 10.222.0.71 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019651 Sep 21 12:14:08.745552 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 25/51] 10.222.0.71 () {60 vars in 1210 bytes} [Wed Sep 21 12:14:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:14:08.755089 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-498aae66-e053-4896-ab32-919a20e4214e admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:14:08.760713 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.wsgi [None req-498aae66-e053-4896-ab32-919a20e4214e admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 21 12:14:08.762231 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-498aae66-e053-4896-ab32-919a20e4214e admin admin] Request method failure captured: Sep 21 12:14:08.762231 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 21 12:14:08.762231 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: Accept: application/json Sep 21 12:14:08.762231 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: Accept-Encoding: gzip, deflate Sep 21 12:14:08.762231 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: Connection: keep-alive Sep 21 12:14:08.762231 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: Content-Length: 0 Sep 21 12:14:08.762231 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: Host: 10.222.0.71 Sep 21 12:14:08.762231 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: Openstack-Api-Version: compute 2.92 Sep 21 12:14:08.762231 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: Openstack-System-Scope: None Sep 21 12:14:08.762231 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: User-Agent: python-novaclient Sep 21 12:14:08.762231 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Auth-Token: gAAAAABjKwAQCHqK5slq4U8sujqLhJScTWX58-fvg1CvH1lSisKhQTFKNOCsJqNzAmmgZHnyfcUiU3o7iLhY7WAqJuc-2LCZMP91wj7ACY2TEDyszI1nk9C50ccBl23JTxl3uE6i9nb_AjcCfJY77Dva1K0_ki9-OSsdtXjQ8vnwIsuS1BZBFKk Sep 21 12:14:08.762231 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Domain-Id: None Sep 21 12:14:08.762231 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Domain-Name: None Sep 21 12:14:08.762231 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Identity-Status: Confirmed Sep 21 12:14:08.762231 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Is-Admin-Project: True Sep 21 12:14:08.762231 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Openstack-Nova-Api-Version: 2.92 Sep 21 12:14:08.762231 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Project-Domain-Id: default Sep 21 12:14:08.762231 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Project-Domain-Name: Default Sep 21 12:14:08.762231 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Project-Id: 5d4deb4c3b0e444f92c029c040b5603c Sep 21 12:14:08.762231 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Project-Name: admin Sep 21 12:14:08.762231 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Role: reader,admin,member Sep 21 12:14:08.762231 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Roles: reader,admin,member Sep 21 12:14:08.763827 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/5d4deb4c3b0e444f92c029c040b5603c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/5d4deb4c3b0e444f92c029c040b5603c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_5d4deb4c3b0e444f92c029c040b5603c", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/5d4deb4c3b0e444f92c029c040b5603c"}]}] Sep 21 12:14:08.763827 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Tenant: admin Sep 21 12:14:08.763827 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Tenant-Id: 5d4deb4c3b0e444f92c029c040b5603c Sep 21 12:14:08.763827 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-Tenant-Name: admin Sep 21 12:14:08.763827 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-User: admin Sep 21 12:14:08.763827 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-User-Domain-Id: default Sep 21 12:14:08.763827 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-User-Domain-Name: Default Sep 21 12:14:08.763827 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-User-Id: 661f5d19be0f436ca14e6e9b440ca709 Sep 21 12:14:08.763827 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: X-User-Name: admin Sep 21 12:14:08.763827 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: method: > Sep 21 12:14:08.763827 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: exception: Flavor 451 could not be found. Sep 21 12:14:08.763827 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: action_args: {'id': '451'} Sep 21 12:14:08.763827 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:14:08.763827 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:14:08.765642 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 21 12:14:08.765642 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 21 12:14:08.765642 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 21 12:14:08.765642 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 21 12:14:08.765642 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 21 12:14:08.765642 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 21 12:14:08.765642 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 21 12:14:08.765642 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 21 12:14:08.765642 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 21 12:14:08.765642 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:14:08.765642 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 21 12:14:08.765642 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 21 12:14:08.765642 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 21 12:14:08.765642 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Sep 21 12:14:08.765642 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:14:08.765642 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Sep 21 12:14:08.765642 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:14:08.765642 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:14:08.765642 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:14:08.766958 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:14:08.766958 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:14:08.766958 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:14:08.766958 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:14:08.766958 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 21 12:14:08.766958 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:14:08.766958 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 21 12:14:08.766958 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Sep 21 12:14:08.766958 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:14:08.766958 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Sep 21 12:14:08.766958 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:14:08.766958 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:14:08.766958 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:14:08.766958 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:14:08.766958 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:14:08.766958 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 21 12:14:08.766958 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: ERROR nova.api.openstack.wsgi Sep 21 12:14:08.766958 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-498aae66-e053-4896-ab32-919a20e4214e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105419) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:14:08.768171 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-498aae66-e053-4896-ab32-919a20e4214e admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012093 Sep 21 12:14:08.768171 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 27/52] 10.222.0.71 () {60 vars in 1193 bytes} [Wed Sep 21 12:14:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 21 12:14:09.988078 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-3fc2b4a8-3fcd-4dd7-ae63-29af1052145a admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:14:09.989099 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-3fc2b4a8-3fcd-4dd7-ae63-29af1052145a admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 21 12:14:09.989490 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 26/53] 10.222.0.71 () {56 vars in 1074 bytes} [Wed Sep 21 12:14:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:14:10.518095 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-4b63b90d-b9e3-48b7-8aa7-9e95a2f1a721 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:14:10.538098 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-4b63b90d-b9e3-48b7-8aa7-9e95a2f1a721 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.408952 Sep 21 12:14:10.538649 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 28/54] 10.222.0.71 () {64 vars in 1235 bytes} [Wed Sep 21 12:14:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 12:14:11.757068 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-3fc2b4a8-3fcd-4dd7-ae63-29af1052145a admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:14:11.758236 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-3fc2b4a8-3fcd-4dd7-ae63-29af1052145a admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Sep 21 12:14:11.758733 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 27/55] 10.222.0.71 () {56 vars in 1074 bytes} [Wed Sep 21 12:14:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:14:12.284760 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-13ee118a-54cd-4e9f-ba36-1a259110539c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:14:12.302937 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-13ee118a-54cd-4e9f-ba36-1a259110539c admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.405530 Sep 21 12:14:12.303473 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 29/56] 10.222.0.71 () {64 vars in 1235 bytes} [Wed Sep 21 12:14:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 12:14:13.579809 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-3fc2b4a8-3fcd-4dd7-ae63-29af1052145a admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:14:13.580813 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-3fc2b4a8-3fcd-4dd7-ae63-29af1052145a admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Sep 21 12:14:13.581210 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 28/57] 10.222.0.71 () {56 vars in 1074 bytes} [Wed Sep 21 12:14:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:14:14.103814 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-d8f81951-f588-4574-abc6-979239028168 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:14:14.124114 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-d8f81951-f588-4574-abc6-979239028168 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.406109 Sep 21 12:14:14.124646 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 30/58] 10.222.0.71 () {64 vars in 1235 bytes} [Wed Sep 21 12:14:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 12:14:15.360709 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-3fc2b4a8-3fcd-4dd7-ae63-29af1052145a admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:14:15.361707 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-3fc2b4a8-3fcd-4dd7-ae63-29af1052145a admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Sep 21 12:14:15.362101 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 29/59] 10.222.0.71 () {56 vars in 1074 bytes} [Wed Sep 21 12:14:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:14:15.887946 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-69b0105c-58c2-485b-b1e9-5370f7f40d07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:14:15.906059 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-69b0105c-58c2-485b-b1e9-5370f7f40d07 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.408053 Sep 21 12:14:15.906596 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 31/60] 10.222.0.71 () {64 vars in 1235 bytes} [Wed Sep 21 12:14:15 2022] POST /compute/v2.1/flavors => generated 409 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 12:14:17.139059 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-3fc2b4a8-3fcd-4dd7-ae63-29af1052145a admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:14:17.140118 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-3fc2b4a8-3fcd-4dd7-ae63-29af1052145a admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Sep 21 12:14:17.140531 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 30/61] 10.222.0.71 () {56 vars in 1074 bytes} [Wed Sep 21 12:14:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:14:17.665806 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-2f70288e-d110-4fb5-8632-3cf4613853e5 admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:14:17.686281 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-2f70288e-d110-4fb5-8632-3cf4613853e5 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.407765 Sep 21 12:14:17.686755 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 32/62] 10.222.0.71 () {60 vars in 1202 bytes} [Wed Sep 21 12:14:17 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:15:15.791315 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-3fc2b4a8-3fcd-4dd7-ae63-29af1052145a admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:15:15.792370 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-3fc2b4a8-3fcd-4dd7-ae63-29af1052145a admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Sep 21 12:15:15.792809 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 31/63] 10.222.0.71 () {54 vars in 931 bytes} [Wed Sep 21 12:15:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:15:15.803344 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG dbcounter [-] [105419] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:15:16.185235 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-191240bf-5061-44f3-913d-db5da53b88cb admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:15:16.206410 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-191240bf-5061-44f3-913d-db5da53b88cb admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.407423 Sep 21 12:15:16.206951 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 33/64] 10.222.0.71 () {60 vars in 1292 bytes} [Wed Sep 21 12:15:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:15:16.227950 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writing DB stats nova_api:SELECT=14 {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:15:16.231795 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-d5fe4a0e-c505-42ab-ac3d-4a847bbf35f7 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:15:16.239269 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-d5fe4a0e-c505-42ab-ac3d-4a847bbf35f7 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012781 Sep 21 12:15:16.239810 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 32/65] 10.222.0.71 () {60 vars in 1283 bytes} [Wed Sep 21 12:15:16 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:15:16.252919 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-04278a24-c16c-4886-971f-47dc5b93cb95 admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:15:16.261361 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-04278a24-c16c-4886-971f-47dc5b93cb95 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012053 Sep 21 12:15:16.261923 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 34/66] 10.222.0.71 () {60 vars in 1286 bytes} [Wed Sep 21 12:15:16 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:15:16.273707 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-18c8297d-3119-4379-b38e-cecf5daa8937 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:15:16.280963 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-18c8297d-3119-4379-b38e-cecf5daa8937 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010901 Sep 21 12:15:16.281481 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 33/67] 10.222.0.71 () {60 vars in 1286 bytes} [Wed Sep 21 12:15:16 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:15:16.292986 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-dfffabd8-318b-4edb-a753-65765582b671 admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:15:16.300209 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-dfffabd8-318b-4edb-a753-65765582b671 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010800 Sep 21 12:15:16.300736 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 35/68] 10.222.0.71 () {60 vars in 1283 bytes} [Wed Sep 21 12:15:16 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:18:39.092663 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-18c8297d-3119-4379-b38e-cecf5daa8937 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:18:39.093674 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-18c8297d-3119-4379-b38e-cecf5daa8937 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 21 12:18:39.094065 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 34/69] 10.222.0.71 () {56 vars in 1074 bytes} [Wed Sep 21 12:18:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:18:39.235527 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG dbcounter [-] [105419] Writing DB stats nova_api:SELECT=6 {{(pid=105419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:18:39.393109 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-eaea5564-47cf-4607-a77a-f0f76883598b admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:18:39.397830 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-eaea5564-47cf-4607-a77a-f0f76883598b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:18:39.398302 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-eaea5564-47cf-4607-a77a-f0f76883598b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:18:39.398728 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-eaea5564-47cf-4607-a77a-f0f76883598b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:18:39.399439 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-eaea5564-47cf-4607-a77a-f0f76883598b admin admin] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:18:39.399917 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-eaea5564-47cf-4607-a77a-f0f76883598b admin admin] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:18:39.400336 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-eaea5564-47cf-4607-a77a-f0f76883598b admin admin] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:18:39.431766 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-eaea5564-47cf-4607-a77a-f0f76883598b admin admin] 10.222.0.71 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.197562 Sep 21 12:18:39.432336 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 36/70] 10.222.0.71 () {60 vars in 1193 bytes} [Wed Sep 21 12:18:39 2022] GET /compute/v2.1/os-services => generated 791 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 12:18:40.524791 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-18c8297d-3119-4379-b38e-cecf5daa8937 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:18:40.525846 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-18c8297d-3119-4379-b38e-cecf5daa8937 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Sep 21 12:18:40.526241 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 35/71] 10.222.0.71 () {56 vars in 1074 bytes} [Wed Sep 21 12:18:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:18:40.714945 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-14d640d8-28ef-4751-ab0a-9656d9831364 admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:18:40.718400 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-14d640d8-28ef-4751-ab0a-9656d9831364 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:18:40.718880 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-14d640d8-28ef-4751-ab0a-9656d9831364 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:18:40.719309 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-14d640d8-28ef-4751-ab0a-9656d9831364 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:18:40.720050 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-14d640d8-28ef-4751-ab0a-9656d9831364 admin admin] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:18:40.720985 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-14d640d8-28ef-4751-ab0a-9656d9831364 admin admin] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:18:40.721404 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-14d640d8-28ef-4751-ab0a-9656d9831364 admin admin] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:18:40.742137 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-14d640d8-28ef-4751-ab0a-9656d9831364 admin admin] 10.222.0.71 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.076805 Sep 21 12:18:40.742137 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 37/72] 10.222.0.71 () {60 vars in 1193 bytes} [Wed Sep 21 12:18:40 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 12:18:52.249091 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-18c8297d-3119-4379-b38e-cecf5daa8937 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:18:52.250138 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-18c8297d-3119-4379-b38e-cecf5daa8937 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Sep 21 12:18:52.250534 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 36/73] 10.222.0.71 () {56 vars in 1074 bytes} [Wed Sep 21 12:18:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:18:52.393241 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG dbcounter [-] [105419] Writing DB stats nova_cell0:SELECT=4 {{(pid=105419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:18:52.393952 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG dbcounter [-] [105419] Writing DB stats nova_cell1:SELECT=4 {{(pid=105419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:18:52.394553 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG dbcounter [-] [105419] Writing DB stats nova_api:SELECT=8 {{(pid=105419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:18:52.446885 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-560267da-f453-45d4-9e8d-bc7d96cf6fa2 admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:18:52.450727 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-560267da-f453-45d4-9e8d-bc7d96cf6fa2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:18:52.451269 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-560267da-f453-45d4-9e8d-bc7d96cf6fa2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:18:52.452209 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-560267da-f453-45d4-9e8d-bc7d96cf6fa2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:18:52.452525 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-560267da-f453-45d4-9e8d-bc7d96cf6fa2 admin admin] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:18:52.453229 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-560267da-f453-45d4-9e8d-bc7d96cf6fa2 admin admin] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:18:52.453719 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-560267da-f453-45d4-9e8d-bc7d96cf6fa2 admin admin] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:18:52.489619 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-560267da-f453-45d4-9e8d-bc7d96cf6fa2 admin admin] 10.222.0.71 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.099699 Sep 21 12:18:52.490471 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 38/74] 10.222.0.71 () {60 vars in 1193 bytes} [Wed Sep 21 12:18:52 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:18:53.593588 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-18c8297d-3119-4379-b38e-cecf5daa8937 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:18:53.594602 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-18c8297d-3119-4379-b38e-cecf5daa8937 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Sep 21 12:18:53.595592 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 37/75] 10.222.0.71 () {56 vars in 1074 bytes} [Wed Sep 21 12:18:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:18:53.785506 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG nova.api.openstack.wsgi [None req-7d5c7bc4-1107-4035-9581-04b24db2ca53 admin admin] Calling method '>' {{(pid=105419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:18:53.788894 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-7d5c7bc4-1107-4035-9581-04b24db2ca53 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:18:53.789362 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-7d5c7bc4-1107-4035-9581-04b24db2ca53 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:18:53.789786 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-7d5c7bc4-1107-4035-9581-04b24db2ca53 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:18:53.790495 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-7d5c7bc4-1107-4035-9581-04b24db2ca53 admin admin] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:18:53.790940 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-7d5c7bc4-1107-4035-9581-04b24db2ca53 admin admin] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:18:53.791347 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: DEBUG oslo_concurrency.lockutils [None req-7d5c7bc4-1107-4035-9581-04b24db2ca53 admin admin] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:18:53.812754 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: INFO nova.api.openstack.requestlog [None req-7d5c7bc4-1107-4035-9581-04b24db2ca53 admin admin] 10.222.0.71 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.079054 Sep 21 12:18:53.813250 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: [pid: 105419|app: 0|req: 39/76] 10.222.0.71 () {60 vars in 1193 bytes} [Wed Sep 21 12:18:53 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:19:53.598530 dv-cinder-858678-1-iscsi devstack@n-api.service[105418]: Wed Sep 21 12:19:53 2022 - graceful shutdown triggered... Sep 21 12:19:53.598762 dv-cinder-858678-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 21 12:19:53.599552 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: Gracefully killing worker 2 (pid: 105420)... Sep 21 12:19:53.600575 dv-cinder-858678-1-iscsi devstack@n-api.service[105419]: Gracefully killing worker 1 (pid: 105419)... Sep 21 12:19:53.724860 dv-cinder-858678-1-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writing DB stats nova_api:SELECT=4 {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:19:54.599682 dv-cinder-858678-1-iscsi devstack@n-api.service[105418]: worker 1 buried after 1 seconds Sep 21 12:19:54.600310 dv-cinder-858678-1-iscsi devstack@n-api.service[105418]: worker 2 buried after 1 seconds Sep 21 12:19:54.600310 dv-cinder-858678-1-iscsi devstack@n-api.service[105418]: goodbye to uWSGI. Sep 21 12:19:54.601273 dv-cinder-858678-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 21 12:19:54.601819 dv-cinder-858678-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 21 12:19:54.604627 dv-cinder-858678-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 21 12:19:54.614975 dv-cinder-858678-1-iscsi devstack@n-api.service[120436]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 21 12:19:54.617158 dv-cinder-858678-1-iscsi devstack@n-api.service[120436]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 21 12:19:54 2022] *** Sep 21 12:19:54.617158 dv-cinder-858678-1-iscsi devstack@n-api.service[120436]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 21 12:19:54.617158 dv-cinder-858678-1-iscsi devstack@n-api.service[120436]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 21 12:19:54.617158 dv-cinder-858678-1-iscsi devstack@n-api.service[120436]: nodename: dv-cinder-858678-1-iscsi Sep 21 12:19:54.617158 dv-cinder-858678-1-iscsi devstack@n-api.service[120436]: machine: x86_64 Sep 21 12:19:54.617158 dv-cinder-858678-1-iscsi devstack@n-api.service[120436]: clock source: unix Sep 21 12:19:54.617158 dv-cinder-858678-1-iscsi devstack@n-api.service[120436]: pcre jit disabled Sep 21 12:19:54.617158 dv-cinder-858678-1-iscsi devstack@n-api.service[120436]: detected number of CPU cores: 4 Sep 21 12:19:54.617158 dv-cinder-858678-1-iscsi devstack@n-api.service[120436]: current working directory: / Sep 21 12:19:54.617158 dv-cinder-858678-1-iscsi devstack@n-api.service[120436]: detected binary path: /usr/bin/uwsgi-core Sep 21 12:19:54.617158 dv-cinder-858678-1-iscsi devstack@n-api.service[120436]: your processes number limit is 47680 Sep 21 12:19:54.617911 dv-cinder-858678-1-iscsi devstack@n-api.service[120436]: your memory page size is 4096 bytes Sep 21 12:19:54.617911 dv-cinder-858678-1-iscsi devstack@n-api.service[120436]: detected max file descriptor number: 2048 Sep 21 12:19:54.617911 dv-cinder-858678-1-iscsi devstack@n-api.service[120436]: lock engine: pthread robust mutexes Sep 21 12:19:54.617911 dv-cinder-858678-1-iscsi devstack@n-api.service[120436]: thunder lock: enabled Sep 21 12:19:54.617911 dv-cinder-858678-1-iscsi devstack@n-api.service[120436]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 21 12:19:54.617911 dv-cinder-858678-1-iscsi devstack@n-api.service[120436]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 21 12:19:54.659210 dv-cinder-858678-1-iscsi devstack@n-api.service[120436]: Python main interpreter initialized at 0x561532c959c0 Sep 21 12:19:54.659484 dv-cinder-858678-1-iscsi devstack@n-api.service[120436]: python threads support enabled Sep 21 12:19:54.659623 dv-cinder-858678-1-iscsi devstack@n-api.service[120436]: your server socket listen backlog is limited to 100 connections Sep 21 12:19:54.659740 dv-cinder-858678-1-iscsi devstack@n-api.service[120436]: your mercy for graceful operations on workers is 90 seconds Sep 21 12:19:54.660215 dv-cinder-858678-1-iscsi devstack@n-api.service[120436]: mapped 403077 bytes (393 KB) for 2 cores Sep 21 12:19:54.660448 dv-cinder-858678-1-iscsi devstack@n-api.service[120436]: *** Operational MODE: preforking *** Sep 21 12:19:54.660868 dv-cinder-858678-1-iscsi devstack@n-api.service[120436]: *** uWSGI is running in multiple interpreter mode *** Sep 21 12:19:54.661002 dv-cinder-858678-1-iscsi devstack@n-api.service[120436]: spawned uWSGI master process (pid: 120436) Sep 21 12:19:54.661325 dv-cinder-858678-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 21 12:19:54.661914 dv-cinder-858678-1-iscsi devstack@n-api.service[120436]: spawned uWSGI worker 1 (pid: 120462, cores: 1) Sep 21 12:19:54.662433 dv-cinder-858678-1-iscsi devstack@n-api.service[120436]: spawned uWSGI worker 2 (pid: 120463, cores: 1) Sep 21 12:19:54.662756 dv-cinder-858678-1-iscsi devstack@n-api.service[120436]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 21 12:19:55.336399 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 21 12:19:55.337051 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 21 12:19:56.522880 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 12:19:56.522880 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: from cryptography.utils import int_from_bytes Sep 21 12:19:56.523603 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 12:19:56.523603 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: from cryptography.utils import int_from_bytes Sep 21 12:19:56.524957 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 12:19:56.524957 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: from cryptography.utils import int_from_bytes Sep 21 12:19:56.525375 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 12:19:56.525375 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: from cryptography.utils import int_from_bytes Sep 21 12:19:58.960382 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 21 12:19:58.960964 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 21 12:19:58.961269 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 21 12:19:58.961470 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 21 12:19:58.961740 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 21 12:19:58.962134 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.962469 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.962796 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.963123 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.963457 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.963794 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.964123 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.964516 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.964781 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.965047 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.965369 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.965867 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-858678-1-iscsi {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.966197 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.966515 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.966838 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.967172 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.967484 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.967849 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.968165 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.968681 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.971004 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.971004 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.971004 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.971004 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.971004 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.971421 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.971660 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.971895 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.972218 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.972540 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.972951 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-858678-1-iscsi {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.973280 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.973603 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.973914 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.974358 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.974663 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.974979 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.975306 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.975644 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.976000 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.976327 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.976654 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.976972 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.977299 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.977603 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.977916 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.978255 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.978563 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.978878 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.979182 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.979438 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.979773 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.980114 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.980440 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.980825 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.981027 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.981281 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.981605 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.981930 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.982243 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.982559 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.982885 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.983186 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.983501 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.983832 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.984150 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.984461 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.984788 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.985113 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.985443 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.985792 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.986117 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.986533 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.71 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.986790 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.71 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.987105 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.987456 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.987798 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.988116 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.990777 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.990777 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.990777 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.990777 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.990777 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.990777 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.990777 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.990777 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.992135 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.992135 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.992135 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.992135 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.992135 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.992864 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.992864 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.993156 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.993358 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.993533 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.993838 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.994151 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.994475 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.994776 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.995088 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.995404 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.995712 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.996077 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.996409 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.996739 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.997051 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.997365 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.997676 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.997987 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.998315 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.998625 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.998937 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.999265 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.999575 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:58.999912 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.000235 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.000547 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.000863 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.001719 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.002027 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.002339 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.002660 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.002972 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.003285 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.003593 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.003949 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.004264 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.004668 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.004855 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.005247 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.005458 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.005784 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.006112 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.006427 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.006815 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.007044 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.007378 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.007798 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.008068 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.008415 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.008732 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.009067 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.009400 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.009723 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.010041 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.010360 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.010694 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.011010 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.011325 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.011641 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.012003 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.012330 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.012668 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.012993 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.013624 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.013943 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.014268 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.014591 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.014713 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 21 12:19:59.015143 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 21 12:19:59.015426 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 21 12:19:59.015795 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.015916 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 21 12:19:59.016084 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 21 12:19:59.016411 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.016601 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.016754 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.017525 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.017711 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.017886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.018050 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.018208 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.018355 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.018500 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.018644 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.018796 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.018957 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.019112 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.019258 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.019410 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.019561 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.019714 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.019963 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.020324 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.020324 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.020616 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.020616 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.020912 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-858678-1-iscsi {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.021067 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.021262 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.021423 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.021574 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.021719 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.021875 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.022036 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.022194 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.022348 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.022500 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.022644 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.022804 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.022956 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.023100 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.023244 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.023387 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.023528 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.023705 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.023893 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.024039 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.024190 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.024342 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.024496 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.024684 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.024926 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.025089 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.025243 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.025395 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.025654 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.025905 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.026064 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.026226 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.026373 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.026373 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.026774 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.026928 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.027079 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.027223 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.027375 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-858678-1-iscsi {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.027530 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.027681 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.027865 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.028013 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.028157 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.028381 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.028538 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.028694 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.028840 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.028982 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.029135 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.029293 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.029437 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.029588 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.029740 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.029885 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.030035 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.030216 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.030587 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.030733 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.031020 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.031222 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.031419 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.031582 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.031729 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.031950 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.032099 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.032250 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.032422 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.032579 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.032735 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.032887 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.033040 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.033184 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.033341 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.033500 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.033646 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.033790 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.033933 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.034085 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.034243 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.034388 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.034546 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.034700 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.034851 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.035100 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.035251 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.035403 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.035560 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.035825 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.036090 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.036252 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.036408 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.036561 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.036827 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.036979 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.037140 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.037293 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.037445 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.037596 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.037746 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.037891 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.038057 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.038202 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.038354 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.038499 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.038648 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.038811 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.038972 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.039124 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.039275 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.039427 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.039570 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.039713 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.039894 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.040048 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.040192 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.040353 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.040679 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.040855 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.041030 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.041262 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.041457 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.041457 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.041745 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.71 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.041745 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.71 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.042047 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.042206 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.042357 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.042357 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.042646 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.042790 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.042962 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.043116 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.043271 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.043421 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.043571 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.043723 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.043937 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.044084 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.044235 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.044389 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.044534 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.044677 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.044834 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.044834 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.045232 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.045232 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.045511 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.045511 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.045811 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.046040 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.046299 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.046457 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.046609 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.046769 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.047012 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.047162 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.047319 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.047472 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.047616 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.047791 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.047942 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.048107 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.048252 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.048407 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.048560 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.048719 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.048872 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.049017 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.049167 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.049329 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.049475 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.049631 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.049775 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.049928 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.050073 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.050226 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.050370 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.050529 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.050820 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.050981 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.051134 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.051375 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.051586 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.051736 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.051964 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.052121 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.052265 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.052408 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.052562 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.052715 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.052871 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.053022 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.053174 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.053328 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.053483 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.053636 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.053788 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.053946 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.054098 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.054243 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.054394 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.054538 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.054689 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.054842 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.054986 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.055130 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.055361 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.055522 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.055675 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.055925 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.056170 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.056344 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.056745 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.057075 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.057241 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.057395 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.057541 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.057683 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.057828 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.057979 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.058145 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.058298 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.058443 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.058593 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.058744 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.058897 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.059055 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.059206 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.059360 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.059505 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.059505 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.059813 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.059979 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.060142 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.060323 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.060470 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.060622 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.060926 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.061079 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.061224 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.061521 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.061729 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.061895 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.062156 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.062321 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.062481 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.062625 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.062776 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.062927 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.063083 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.063227 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:19:59.063380 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.063380 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.064174 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.064339 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.064494 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.064639 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.064791 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.064954 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.065107 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.065260 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.065499 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.065658 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.065803 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.065946 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.066099 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.066346 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.066504 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.066660 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.066912 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.067071 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.067938 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.068098 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.068245 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.068410 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.068556 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.068700 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.068843 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.069021 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.069177 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.069333 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.069486 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.069651 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.069796 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.069940 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.070084 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.070237 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.070390 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.070534 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.070677 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.070821 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.071158 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.071312 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.071478 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.071807 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.071967 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.072115 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.072272 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.072418 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.072563 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.072715 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.072715 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.073003 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.073158 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.073310 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.073461 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.073606 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.073760 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.073913 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.074072 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.074224 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.074368 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.074511 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.074655 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.074807 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.074958 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.075109 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.075254 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.075404 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.075652 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.075844 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.076003 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.076157 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.076319 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.076562 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.076721 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.076881 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.076881 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.077297 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.077565 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.077723 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.077870 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.078024 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.078186 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.078330 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.078481 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.078625 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.078779 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.078933 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.079077 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.079222 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.080025 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.080180 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.080331 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.080484 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.080646 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.080790 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.081016 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.081550 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.081733 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.081999 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.082157 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.082309 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.082469 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.082618 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.082790 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.082936 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.083087 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.083258 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.083403 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.083564 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.083663 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.084075 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.084218 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.084327 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.084437 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.084530 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.084614 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.084704 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.084789 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.084885 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.084970 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.085059 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.085059 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.085220 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.085312 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.085405 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.085497 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.085581 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.085687 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.085779 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.085945 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.086039 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.086130 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.086221 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.086304 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.086387 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.086478 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.086770 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.086862 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.086953 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.087037 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.087119 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.087284 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.087418 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.087562 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.087659 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.087659 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.087998 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.088102 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.088194 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.088284 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.088375 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.088460 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.088552 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.088637 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.088719 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.088801 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.088890 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.088890 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.089054 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.089138 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.089221 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.089309 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.089393 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.089482 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.089575 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.089665 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.089749 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.089829 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.089917 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.090014 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.090105 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.090188 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.090278 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.090368 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.090658 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.090770 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.090858 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.090941 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.091023 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.091113 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.091229 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.091330 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.091416 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.091502 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.091592 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.091675 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.091779 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.091879 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.092127 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.092215 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.092297 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.092389 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.092474 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.092570 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.092655 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.092736 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.092873 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.092961 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.093053 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.093138 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.093230 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.093321 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.093405 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.093488 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.093578 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.093663 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.093742 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.093819 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.093890 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.093978 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.094080 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.094175 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.094266 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.094377 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.094472 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.094565 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.094674 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.094775 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.095046 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.095148 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.095352 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.095466 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.095658 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.095809 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.095998 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.096093 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.096327 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.096433 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.096663 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.096903 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.097008 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.097094 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.097255 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.097364 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.097564 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.097667 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.097872 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.097982 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.098182 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.098288 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.098492 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.098593 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.098796 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.098888 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.099101 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.099202 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.099406 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.099507 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.099712 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.099839 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.100092 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.100184 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.100419 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.100514 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.100736 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.100828 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.101043 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.101143 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.101350 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.101442 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.101656 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.101756 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.102004 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.102234 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.102329 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.102414 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.102631 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.102738 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.102951 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.103053 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.103268 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.103360 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.103590 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.103697 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.103934 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.104026 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.104249 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.104339 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.104567 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.104668 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.104880 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.104975 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.105217 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.105357 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.105515 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.105656 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.105830 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.105972 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.106139 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.106229 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.106458 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.106594 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.106930 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.107065 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.107184 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.107303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.107444 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.111908 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.111908 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.112976 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.113071 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.113168 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.113257 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.113348 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.113443 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.113536 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.113621 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.113711 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.113796 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.113878 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.113969 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.114050 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.114141 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.114225 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.114315 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.114400 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.114400 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.114574 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.114574 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.114726 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.114816 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.114926 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.115020 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.115105 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.115187 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.115276 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.115359 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.115455 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.115619 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.115715 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.115818 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.115914 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.116000 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.116097 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.116189 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.116281 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.116365 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.116454 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.116545 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.116658 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.116747 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.116828 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.116917 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.117014 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.117096 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.117178 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.117250 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.117319 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.117394 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.117472 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.117544 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.117622 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.117622 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.117622 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.117622 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.117873 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.117956 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.118035 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.118106 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.118181 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.118259 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.118329 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.118411 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.118489 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.119037 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.119245 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.119333 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.119439 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.119525 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.119617 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.119708 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.119854 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.120023 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.120140 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.120289 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.120477 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.120611 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.120805 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.120942 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.121129 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.121254 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.121453 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.121565 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.121776 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.121879 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.122099 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.122191 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.122485 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.122637 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.122762 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.122865 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.123062 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.123204 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.123387 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.123524 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.123706 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.123866 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.124069 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.124291 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.124391 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.124610 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.124753 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.124929 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.125256 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.125355 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.125583 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.125674 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.125914 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.126015 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.126734 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.126832 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.127054 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.127154 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.127370 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.127477 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.127699 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.127841 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.128053 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.128147 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.128371 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.128470 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.128709 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.128855 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.129015 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.129112 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.129325 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.129432 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.129635 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.129741 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.129955 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.130047 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.130269 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.130360 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.130580 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.130680 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.130891 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.131012 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.131209 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.131331 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.131522 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.131660 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.131869 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.132020 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.132185 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.132336 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.132488 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.132633 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.132882 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.132998 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.133116 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.133251 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.133454 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.133560 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.133758 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.133877 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.134090 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.134315 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.134414 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.134507 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.134706 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.134806 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.135014 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.135121 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.135325 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.135424 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.135677 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.135819 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.136019 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.136128 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.136338 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.136430 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.136667 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.136759 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.136987 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.137088 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.137314 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.137406 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.137626 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.137725 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.137940 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.138040 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.138257 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.138348 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.138569 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.138668 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.138878 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.138976 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.139188 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.139280 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.139499 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.139602 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.139835 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.139933 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.140155 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.140247 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.140470 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.140575 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.140786 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.140878 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.141101 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.141237 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.141410 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.141516 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.141760 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.142439 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.142617 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.142756 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.143029 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.143153 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.143243 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.143325 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.143567 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.143666 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.143920 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.144033 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.144233 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.144333 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.144543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.144635 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.144854 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.144955 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.145161 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.145253 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.145470 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.145560 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.145777 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.145877 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.146089 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.146180 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.146397 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.146495 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.146702 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.146794 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.147009 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.147100 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.147322 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.147414 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.147630 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.147722 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.147982 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.148088 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.148296 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.148395 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.148604 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.148703 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.148911 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.149042 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.149216 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.149393 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.149524 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.149605 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.149831 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.149931 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.150145 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.150252 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.150472 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.150563 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.150793 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.150886 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.151103 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.151209 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.151422 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.151515 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.151727 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.151895 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.152061 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.152168 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.152371 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.152473 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.152686 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.152788 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.152992 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.153144 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.153305 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.153432 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.153624 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.153736 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.153934 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.154030 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.154244 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.154353 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.154574 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.154805 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.154904 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.155137 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.155245 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.155456 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.155570 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.155790 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.155889 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.156110 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.156208 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.156430 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.156543 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.156747 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.156853 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.157064 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.157171 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.157404 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.157526 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.157723 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.157825 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.158038 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.158131 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.158372 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.158466 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.158687 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.158784 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.159000 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.159100 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.159324 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.159424 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.159641 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.159733 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.159996 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.160097 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.160308 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.160401 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.160619 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.160714 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.160946 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.161045 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.161266 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.161369 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.161581 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.161717 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.161936 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.162053 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.162217 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.162310 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.162535 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.162628 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.162842 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.162983 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.163156 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.163289 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.163478 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.163594 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.163817 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.163931 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.164141 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.164242 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.164451 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.164559 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.164766 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.164869 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.165082 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.165175 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.165398 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.165491 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.165719 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.165821 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.166038 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.166131 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.166353 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.166446 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.166668 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.166767 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.166984 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.167084 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.167298 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.167512 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.167630 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.167862 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.167977 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.168206 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.168298 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.168539 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.168642 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.168871 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.168964 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.169193 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.169293 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.169505 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.169603 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.169840 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.169940 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.170154 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.170253 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.170466 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.170566 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.170792 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.170885 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.171109 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.171282 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.171420 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.171514 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.171748 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.171877 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.172090 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.172197 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.172400 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.172493 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.172726 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.172817 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.173064 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.173184 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.173497 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.173723 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.173841 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.173952 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.174121 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.174258 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.174434 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.174563 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.174753 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.174872 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.175086 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.175222 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.175400 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.175519 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.175711 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.175870 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.176051 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.176172 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.176384 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.176505 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.176698 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.176816 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.177026 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.177155 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.177335 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.177454 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.177647 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.177791 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.177964 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.178092 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.178389 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.178522 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.178643 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.178769 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.178882 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.179089 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.179209 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.179420 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.179539 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.179750 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.179926 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.180102 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.180235 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.180417 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.180565 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.180736 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.180875 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.181061 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.181193 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.181342 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.181462 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.181708 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.181851 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.181982 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.182120 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.182259 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.182405 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.182558 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.182692 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.182923 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.183051 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.183267 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.183415 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.183571 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.183721 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.183983 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.184121 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.184260 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.184401 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.184574 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.184679 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.184907 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.185059 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.185244 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.185375 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.185681 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.185791 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.186040 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.186227 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.186339 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.186532 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.186681 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.186785 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.187037 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.187187 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.187357 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.187507 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.187710 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.187909 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.188044 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.188241 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.188387 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.189204 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.189316 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.189528 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.189631 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.189871 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.189986 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.190213 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.190315 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.190596 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.190713 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.190910 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.191131 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.191227 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.191453 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.191546 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.191789 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.191930 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.192126 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.192252 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.192448 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.192543 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.192771 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.192874 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.193090 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.193201 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.193410 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.193545 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.193728 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.193823 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.194092 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.194233 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.194367 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.194473 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.194686 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.194781 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.195004 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.195107 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.195321 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.195421 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.195637 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.195731 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.195977 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.196084 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.196294 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.196403 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.196609 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.196711 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.196930 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.197023 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.197273 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.197374 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.197593 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.197730 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.197915 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.198007 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.198227 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.198351 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.198539 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.198637 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.198854 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.198976 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.199192 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.199308 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.199489 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.199584 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.199816 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.199936 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.200130 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.200227 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.200434 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.200529 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.200709 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.200811 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.201013 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.201109 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.201343 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.201444 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.201669 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.201770 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.202040 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.202137 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.202314 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.202416 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.202607 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.202712 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.202903 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.202998 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.203197 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.203324 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.203554 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.203663 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.203908 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.204017 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.204305 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.204894 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.205145 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.205253 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.205480 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.205574 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.205807 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.205918 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.206132 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.206238 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.206442 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.206544 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.206754 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.206856 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.207066 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.207161 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.207382 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.207483 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.207701 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.207835 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.208039 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.208133 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.208349 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.208441 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.208657 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.209015 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.209239 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.209340 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.209547 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.209801 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.209895 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.210139 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.210293 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.210541 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.210669 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.210766 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.210853 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.211050 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.211150 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.211359 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.211452 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.211667 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.211789 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.212004 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.212151 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.212302 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.212396 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.212610 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.212701 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.212926 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.213020 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.213235 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.213327 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.213545 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.213675 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.213853 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.213950 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.214161 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.214297 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.214467 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.214605 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.214803 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.214903 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.215140 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.215247 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.215461 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.215568 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.215804 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.215904 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.216123 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.216234 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.216449 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.216549 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.216764 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.216857 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.217086 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.217177 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.217408 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.217502 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.217726 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.217820 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.218040 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.218132 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.218356 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.218456 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.218672 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.218765 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.218986 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.219080 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.219299 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.219401 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.219613 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.219704 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.220502 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.220626 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.220804 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.220905 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.221137 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.221230 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.221466 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.221569 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.221778 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.221877 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.222094 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.222236 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.222415 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.222521 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.222740 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.222945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.223060 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.223266 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.223374 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.223611 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.223717 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.224293 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.224394 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.224495 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.224597 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.224726 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.224819 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.224904 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.224986 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.225234 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.225342 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.225548 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.225677 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.225859 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.225985 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.226175 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.226270 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.226492 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.226583 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.226804 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.226897 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.227130 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.227267 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.227447 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.227538 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.227798 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.227895 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.228110 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.228211 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.228429 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.228522 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.228781 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.228974 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.229100 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.229330 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.229449 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.229653 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.229783 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.229985 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.230086 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.230318 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.230410 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.230645 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.230750 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.230940 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 21 12:19:59.231033 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.231276 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.231591 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.231939 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.232262 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.232581 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.232894 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.233206 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.233531 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.233849 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.234162 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.234479 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.234789 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.235124 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.235440 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.236366 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.236683 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.237005 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.237319 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.237633 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.237947 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.238262 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.238582 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.238894 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.239310 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.239624 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.239971 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.240331 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.240666 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.241005 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.241291 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.241603 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.241914 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.242238 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.242557 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.242885 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.243207 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.243532 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.243909 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.244238 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.244791 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.245133 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.245467 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.245810 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.246150 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.246466 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.246782 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.247097 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.247430 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.247750 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.248097 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.248411 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.248730 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.249047 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.249365 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.249681 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.249999 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.250314 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.250630 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.250947 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.251310 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.251630 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.251978 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.252296 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.252642 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.252966 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.253317 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.253620 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.253943 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.254263 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.254575 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.254892 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.255207 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.255545 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.255888 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.256211 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.256523 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.256954 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.257272 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.257597 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.257925 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.258243 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.258571 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.258900 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.259217 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.259545 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.259893 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.260234 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.260582 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.260968 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.261338 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.261542 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.261902 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.262167 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.262485 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.262811 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.263128 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.263442 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.263779 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.264089 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.264400 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.264711 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.265022 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.265331 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.265649 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.266007 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.266266 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.266614 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.266985 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.267329 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.267663 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.268008 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.268322 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.268635 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.268945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.269257 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.269567 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.269907 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.270244 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.270567 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.270895 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.271212 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.271542 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.271885 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.272214 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.272543 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.272866 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.273184 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.273531 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.273852 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.274174 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.274494 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.274813 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.275132 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.275448 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.275810 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.276148 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.276461 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.276791 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.277114 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.277441 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.277763 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.278082 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.278419 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.278738 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.279054 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.279372 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.279689 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.280032 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.280354 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.280672 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.280988 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.281310 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.281635 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.281966 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.282297 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.283154 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.283489 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.283848 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.284207 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.284528 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.284878 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.285214 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.285535 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.285853 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.286164 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:19:59.286413 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 21 12:19:59.293012 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO dbcounter [None req-5b1d4d29-8ac6-4659-b99f-6621a4d4a1e7 None None] Registered counter for database nova_api Sep 21 12:19:59.314245 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_db.sqlalchemy.engines [None req-5b1d4d29-8ac6-4659-b99f-6621a4d4a1e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 12:19:59.320986 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writer thread running {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 12:19:59.349521 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO dbcounter [None req-740bf3d4-1755-4754-9976-8d1b60dc467a None None] Registered counter for database nova_api Sep 21 12:19:59.370264 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_db.sqlalchemy.engines [None req-740bf3d4-1755-4754-9976-8d1b60dc467a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120463) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 12:19:59.377322 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writer thread running {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 12:19:59.377603 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.context [None req-5b1d4d29-8ac6-4659-b99f-6621a4d4a1e7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5e3c3fc2-6e53-4c4a-a73a-c41818930d93(cell1) {{(pid=120462) load_cells /opt/stack/nova/nova/context.py:464}} Sep 21 12:19:59.381650 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5b1d4d29-8ac6-4659-b99f-6621a4d4a1e7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:19:59.382133 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5b1d4d29-8ac6-4659-b99f-6621a4d4a1e7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:19:59.383702 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5b1d4d29-8ac6-4659-b99f-6621a4d4a1e7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:19:59.384480 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5b1d4d29-8ac6-4659-b99f-6621a4d4a1e7 None None] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:19:59.384932 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5b1d4d29-8ac6-4659-b99f-6621a4d4a1e7 None None] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:19:59.386993 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5b1d4d29-8ac6-4659-b99f-6621a4d4a1e7 None None] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:19:59.388958 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO dbcounter [None req-5b1d4d29-8ac6-4659-b99f-6621a4d4a1e7 None None] Registered counter for database nova_cell0 Sep 21 12:19:59.393629 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO dbcounter [None req-5b1d4d29-8ac6-4659-b99f-6621a4d4a1e7 None None] Registered counter for database nova_cell1 Sep 21 12:19:59.401234 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_db.sqlalchemy.engines [None req-5b1d4d29-8ac6-4659-b99f-6621a4d4a1e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 12:19:59.403286 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_db.sqlalchemy.engines [None req-5b1d4d29-8ac6-4659-b99f-6621a4d4a1e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 12:19:59.408655 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writer thread running {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 12:19:59.414422 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writer thread running {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 12:19:59.434428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.context [None req-740bf3d4-1755-4754-9976-8d1b60dc467a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5e3c3fc2-6e53-4c4a-a73a-c41818930d93(cell1) {{(pid=120463) load_cells /opt/stack/nova/nova/context.py:464}} Sep 21 12:19:59.438607 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-740bf3d4-1755-4754-9976-8d1b60dc467a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:19:59.439098 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-740bf3d4-1755-4754-9976-8d1b60dc467a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:19:59.440697 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-740bf3d4-1755-4754-9976-8d1b60dc467a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:19:59.441463 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-740bf3d4-1755-4754-9976-8d1b60dc467a None None] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:19:59.441916 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-740bf3d4-1755-4754-9976-8d1b60dc467a None None] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:19:59.443946 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-740bf3d4-1755-4754-9976-8d1b60dc467a None None] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:19:59.445931 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO dbcounter [None req-740bf3d4-1755-4754-9976-8d1b60dc467a None None] Registered counter for database nova_cell0 Sep 21 12:19:59.449968 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO dbcounter [None req-740bf3d4-1755-4754-9976-8d1b60dc467a None None] Registered counter for database nova_cell1 Sep 21 12:19:59.458230 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_db.sqlalchemy.engines [None req-740bf3d4-1755-4754-9976-8d1b60dc467a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120463) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 12:19:59.460908 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_db.sqlalchemy.engines [None req-740bf3d4-1755-4754-9976-8d1b60dc467a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120463) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 12:19:59.465556 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writer thread running {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 12:19:59.468701 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writer thread running {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 12:19:59.565897 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO dbcounter [None req-5b1d4d29-8ac6-4659-b99f-6621a4d4a1e7 None None] Registered counter for database nova_cell0 Sep 21 12:19:59.572894 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_db.sqlalchemy.engines [None req-5b1d4d29-8ac6-4659-b99f-6621a4d4a1e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 12:19:59.577391 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writer thread running {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 12:19:59.628848 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO dbcounter [None req-740bf3d4-1755-4754-9976-8d1b60dc467a None None] Registered counter for database nova_cell0 Sep 21 12:19:59.636344 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_db.sqlalchemy.engines [None req-740bf3d4-1755-4754-9976-8d1b60dc467a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120463) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 12:19:59.641075 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writer thread running {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 12:19:59.900591 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: WARNING keystonemiddleware.auth_token [None req-5b1d4d29-8ac6-4659-b99f-6621a4d4a1e7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 21 12:19:59.907912 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: WARNING keystonemiddleware.auth_token [None req-5b1d4d29-8ac6-4659-b99f-6621a4d4a1e7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 21 12:19:59.962591 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: WARNING keystonemiddleware.auth_token [None req-740bf3d4-1755-4754-9976-8d1b60dc467a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 21 12:19:59.970582 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: WARNING keystonemiddleware.auth_token [None req-740bf3d4-1755-4754-9976-8d1b60dc467a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 21 12:20:00.252682 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: WARNING keystonemiddleware.auth_token [None req-5b1d4d29-8ac6-4659-b99f-6621a4d4a1e7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 21 12:20:00.259507 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: WARNING keystonemiddleware.auth_token [None req-5b1d4d29-8ac6-4659-b99f-6621a4d4a1e7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 21 12:20:00.265241 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561532c959c0 pid: 120462 (default app) Sep 21 12:20:00.319965 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: WARNING keystonemiddleware.auth_token [None req-740bf3d4-1755-4754-9976-8d1b60dc467a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 21 12:20:00.326017 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: WARNING keystonemiddleware.auth_token [None req-740bf3d4-1755-4754-9976-8d1b60dc467a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 21 12:20:00.331348 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561532c959c0 pid: 120463 (default app) Sep 21 12:20:37.074776 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_api:SELECT=3 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:20:37.075903 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=3 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:20:37.076907 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell0:SELECT=3 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:20:37.080259 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell0:SELECT=3 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:20:38.014800 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-d4a0dc5b-6c57-484d-ae8c-7c7c53715616 tempest-VolumesGetTestJSON-381284173 tempest-VolumesGetTestJSON-381284173-project] Action: 'create', calling method: .version_select at 0x7fe4c9f07430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1837780270", "metadata": {"Type": "work"}}} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:20:39.231391 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=3 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:20:39.232900 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=3 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:20:39.237064 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell0:SELECT=3 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:20:39.238444 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell0:SELECT=3 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:20:39.468744 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-d4a0dc5b-6c57-484d-ae8c-7c7c53715616 tempest-VolumesGetTestJSON-381284173 tempest-VolumesGetTestJSON-381284173-project] 10.222.0.71 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.411089 Sep 21 12:20:39.470055 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 1/1] 10.222.0.71 () {60 vars in 1156 bytes} [Wed Sep 21 12:20:37 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2414 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 21 12:20:39.487111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-1621ba93-4e16-4618-853d-678409bd89f0 tempest-VolumesGetTestJSON-381284173 tempest-VolumesGetTestJSON-381284173-project] Calling method '.version_select at 0x7fe4c9ddc310>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:20:39.618889 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-1621ba93-4e16-4618-853d-678409bd89f0 tempest-VolumesGetTestJSON-381284173 tempest-VolumesGetTestJSON-381284173-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/e2a23794-aa7b-414a-988a-eae0d21de02c" status: 200 len: 353 microversion: 2.1 time: 0.137608 Sep 21 12:20:39.619861 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 2/2] 10.222.0.71 () {58 vars in 1245 bytes} [Wed Sep 21 12:20:39 2022] GET /compute/v2.1/os-volumes/e2a23794-aa7b-414a-988a-eae0d21de02c => generated 353 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:20:39.638129 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-0b309d54-5a14-494a-982b-4eca5438c719 tempest-VolumesTestJSON-801822396 tempest-VolumesTestJSON-801822396-project] Calling method '.version_select at 0x7fe4c9fb9940>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:20:40.437400 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-0b309d54-5a14-494a-982b-4eca5438c719 tempest-VolumesTestJSON-801822396 tempest-VolumesTestJSON-801822396-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/bb58f59c-afc4-4563-8e81-b5d0225c1ecd" status: 200 len: 350 microversion: 2.1 time: 1.213026 Sep 21 12:20:40.439296 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 1/3] 10.222.0.71 () {58 vars in 1245 bytes} [Wed Sep 21 12:20:39 2022] GET /compute/v2.1/os-volumes/bb58f59c-afc4-4563-8e81-b5d0225c1ecd => generated 350 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:20:40.634583 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-cac55784-a7bf-4b49-a015-870943691eb2 tempest-VolumesGetTestJSON-381284173 tempest-VolumesGetTestJSON-381284173-project] Calling method '.version_select at 0x7fe4c9ddc9d0>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:20:40.755001 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-cac55784-a7bf-4b49-a015-870943691eb2 tempest-VolumesGetTestJSON-381284173 tempest-VolumesGetTestJSON-381284173-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/e2a23794-aa7b-414a-988a-eae0d21de02c" status: 200 len: 354 microversion: 2.1 time: 0.125039 Sep 21 12:20:40.755858 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 3/4] 10.222.0.71 () {58 vars in 1245 bytes} [Wed Sep 21 12:20:40 2022] GET /compute/v2.1/os-volumes/e2a23794-aa7b-414a-988a-eae0d21de02c => generated 354 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:20:40.772518 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-c776f5ee-32ed-4776-b919-072eff1c9cc7 tempest-VolumesGetTestJSON-381284173 tempest-VolumesGetTestJSON-381284173-project] Calling method '.version_select at 0x7fe4c9dc7310>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:20:40.862858 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-c776f5ee-32ed-4776-b919-072eff1c9cc7 tempest-VolumesGetTestJSON-381284173 tempest-VolumesGetTestJSON-381284173-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/e2a23794-aa7b-414a-988a-eae0d21de02c" status: 200 len: 354 microversion: 2.1 time: 0.095328 Sep 21 12:20:40.875538 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 2/5] 10.222.0.71 () {58 vars in 1245 bytes} [Wed Sep 21 12:20:40 2022] GET /compute/v2.1/os-volumes/e2a23794-aa7b-414a-988a-eae0d21de02c => generated 354 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:20:40.879283 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-07553132-75a3-4c08-8281-7c220baf04e7 tempest-VolumesGetTestJSON-381284173 tempest-VolumesGetTestJSON-381284173-project] Calling method '.version_select at 0x7fe4c9dea0d0>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:20:41.001958 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-07553132-75a3-4c08-8281-7c220baf04e7 tempest-VolumesGetTestJSON-381284173 tempest-VolumesGetTestJSON-381284173-project] 10.222.0.71 "DELETE /compute/v2.1/os-volumes/e2a23794-aa7b-414a-988a-eae0d21de02c" status: 202 len: 0 microversion: 2.1 time: 0.127440 Sep 21 12:20:41.003157 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 4/6] 10.222.0.71 () {58 vars in 1248 bytes} [Wed Sep 21 12:20:40 2022] DELETE /compute/v2.1/os-volumes/e2a23794-aa7b-414a-988a-eae0d21de02c => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 12:20:41.012340 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-15b232b9-e6c1-4f46-ae70-9706e1bff743 tempest-VolumesGetTestJSON-381284173 tempest-VolumesGetTestJSON-381284173-project] Calling method '.version_select at 0x7fe4c9dc7a60>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:20:41.131022 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-15b232b9-e6c1-4f46-ae70-9706e1bff743 tempest-VolumesGetTestJSON-381284173 tempest-VolumesGetTestJSON-381284173-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/e2a23794-aa7b-414a-988a-eae0d21de02c" status: 200 len: 353 microversion: 2.1 time: 0.123451 Sep 21 12:20:41.131857 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 3/7] 10.222.0.71 () {58 vars in 1245 bytes} [Wed Sep 21 12:20:41 2022] GET /compute/v2.1/os-volumes/e2a23794-aa7b-414a-988a-eae0d21de02c => generated 353 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:20:42.147631 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-557a3562-49fa-4d19-be58-45a2139a35fd tempest-VolumesGetTestJSON-381284173 tempest-VolumesGetTestJSON-381284173-project] Calling method '.version_select at 0x7fe4c9ddcd30>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:20:42.205018 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.wsgi [None req-557a3562-49fa-4d19-be58-45a2139a35fd tempest-VolumesGetTestJSON-381284173 tempest-VolumesGetTestJSON-381284173-project] HTTP exception thrown: Volume e2a23794-aa7b-414a-988a-eae0d21de02c could not be found. Sep 21 12:20:42.213268 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-557a3562-49fa-4d19-be58-45a2139a35fd tempest-VolumesGetTestJSON-381284173 tempest-VolumesGetTestJSON-381284173-project] Request method failure captured: Sep 21 12:20:42.213268 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: request: GET /compute/v2.1/os-volumes/e2a23794-aa7b-414a-988a-eae0d21de02c HTTP/1.1 Sep 21 12:20:42.213268 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept: application/json Sep 21 12:20:42.213268 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept-Encoding: identity Sep 21 12:20:42.213268 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Connection: close Sep 21 12:20:42.213268 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Length: 0 Sep 21 12:20:42.213268 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Type: application/json Sep 21 12:20:42.213268 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Host: 10.222.0.71 Sep 21 12:20:42.213268 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Openstack-System-Scope: None Sep 21 12:20:42.213268 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: User-Agent: python-urllib3/1.26.12 Sep 21 12:20:42.213268 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Auth-Token: gAAAAABjKwGU4Fifl-vp44QAmx4L0PEYHPLLjs5xDUsuopQQsqcmk6pqc0a48E1v56yZaJ2kTfqOc66W42DqbiyBj4QmiN3KBTLAidzz-HaHEvxI-Qg8PJUpdNKT3CFbmz6MK4O0Rl8NDu9NLBnQqYaCy0Zn6HJgtzEj0RSKAGRSnBrjI9MimIQ Sep 21 12:20:42.213268 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Id: None Sep 21 12:20:42.213268 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Name: None Sep 21 12:20:42.213268 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Identity-Status: Confirmed Sep 21 12:20:42.213268 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Is-Admin-Project: True Sep 21 12:20:42.213268 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Id: default Sep 21 12:20:42.213268 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Name: Default Sep 21 12:20:42.213268 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Id: 1ca32cb607f84222a9f547700f6c5fe4 Sep 21 12:20:42.213268 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Name: tempest-VolumesGetTestJSON-381284173 Sep 21 12:20:42.213268 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Role: reader,member Sep 21 12:20:42.213268 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Roles: reader,member Sep 21 12:20:42.214243 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/1ca32cb607f84222a9f547700f6c5fe4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/1ca32cb607f84222a9f547700f6c5fe4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_1ca32cb607f84222a9f547700f6c5fe4", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/1ca32cb607f84222a9f547700f6c5fe4"}]}] Sep 21 12:20:42.214243 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant: tempest-VolumesGetTestJSON-381284173 Sep 21 12:20:42.214243 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Id: 1ca32cb607f84222a9f547700f6c5fe4 Sep 21 12:20:42.214243 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Name: tempest-VolumesGetTestJSON-381284173 Sep 21 12:20:42.214243 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User: tempest-VolumesGetTestJSON-381284173-project Sep 21 12:20:42.214243 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Id: default Sep 21 12:20:42.214243 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Name: Default Sep 21 12:20:42.214243 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Id: df8530247db44cf09912f1d2d15c1559 Sep 21 12:20:42.214243 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Name: tempest-VolumesGetTestJSON-381284173-project Sep 21 12:20:42.214243 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: method: Sep 21 12:20:42.214243 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: exception: Volume e2a23794-aa7b-414a-988a-eae0d21de02c could not be found. Sep 21 12:20:42.214243 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: action_args: {'id': 'e2a23794-aa7b-414a-988a-eae0d21de02c'} Sep 21 12:20:42.214243 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:20:42.214924 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:20:42.214924 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 21 12:20:42.214924 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 21 12:20:42.214924 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 21 12:20:42.214924 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 21 12:20:42.214924 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 21 12:20:42.214924 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 21 12:20:42.214924 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 21 12:20:42.214924 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 21 12:20:42.214924 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 21 12:20:42.214924 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 21 12:20:42.214924 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 21 12:20:42.214924 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 21 12:20:42.214924 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 21 12:20:42.214924 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 21 12:20:42.214924 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e2a23794-aa7b-414a-988a-eae0d21de02c could not be found. (HTTP 404) (Request-ID: req-830c2bd1-3b69-4e26-8c02-4c750935dc6d) Sep 21 12:20:42.214924 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:20:42.214924 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:20:42.214924 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:20:42.215807 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:20:42.215807 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 21 12:20:42.215807 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 21 12:20:42.215807 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 21 12:20:42.215807 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 21 12:20:42.215807 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 21 12:20:42.215807 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 21 12:20:42.215807 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 21 12:20:42.215807 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 21 12:20:42.215807 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 21 12:20:42.215807 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 21 12:20:42.215807 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 21 12:20:42.215807 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 21 12:20:42.215807 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 21 12:20:42.215807 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 21 12:20:42.215807 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 21 12:20:42.215807 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 21 12:20:42.215807 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 21 12:20:42.215807 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 21 12:20:42.218652 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 21 12:20:42.218652 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 21 12:20:42.218652 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 21 12:20:42.218652 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 21 12:20:42.218652 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e2a23794-aa7b-414a-988a-eae0d21de02c could not be found. Sep 21 12:20:42.218652 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:20:42.218652 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:20:42.218652 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:20:42.218652 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:20:42.218652 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:20:42.218652 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:20:42.218652 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:20:42.218652 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:20:42.218652 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 21 12:20:42.218652 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 21 12:20:42.218652 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:20:42.218652 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:20:42.218652 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 21 12:20:42.218652 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:20:42.221175 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e2a23794-aa7b-414a-988a-eae0d21de02c could not be found. Sep 21 12:20:42.221175 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:20:42.221175 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:20:42.221175 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:20:42.221175 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:20:42.221175 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:20:42.221175 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:20:42.221175 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:20:42.221175 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:20:42.221175 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e2a23794-aa7b-414a-988a-eae0d21de02c could not be found. Sep 21 12:20:42.221175 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:20:42.221175 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-557a3562-49fa-4d19-be58-45a2139a35fd tempest-VolumesGetTestJSON-381284173 tempest-VolumesGetTestJSON-381284173-project] Returning 404 to user: Volume e2a23794-aa7b-414a-988a-eae0d21de02c could not be found. {{(pid=120462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:20:42.221175 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-557a3562-49fa-4d19-be58-45a2139a35fd tempest-VolumesGetTestJSON-381284173 tempest-VolumesGetTestJSON-381284173-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/e2a23794-aa7b-414a-988a-eae0d21de02c" status: 404 len: 109 microversion: 2.1 time: 0.072740 Sep 21 12:20:42.221175 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 5/8] 10.222.0.71 () {58 vars in 1245 bytes} [Wed Sep 21 12:20:42 2022] GET /compute/v2.1/os-volumes/e2a23794-aa7b-414a-988a-eae0d21de02c => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:20:42.349140 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-a4c49023-7470-4a0b-b2be-549deb73dcc1 tempest-VolumesTestJSON-801822396 tempest-VolumesTestJSON-801822396-project] Calling method '.version_select at 0x7fe4c9dd2160>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:20:42.456677 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-a4c49023-7470-4a0b-b2be-549deb73dcc1 tempest-VolumesTestJSON-801822396 tempest-VolumesTestJSON-801822396-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/5dd7a736-83ef-4083-b4da-e05105a80cdc" status: 200 len: 351 microversion: 2.1 time: 0.112017 Sep 21 12:20:42.457247 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 4/9] 10.222.0.71 () {58 vars in 1245 bytes} [Wed Sep 21 12:20:42 2022] GET /compute/v2.1/os-volumes/5dd7a736-83ef-4083-b4da-e05105a80cdc => generated 351 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:20:44.829702 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-f0032a86-e5d6-4e0f-8ba3-89f78aa0faf8 tempest-VolumesTestJSON-801822396 tempest-VolumesTestJSON-801822396-project] Calling method '.version_select at 0x7fe4ca734940>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:20:44.981817 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-f0032a86-e5d6-4e0f-8ba3-89f78aa0faf8 tempest-VolumesTestJSON-801822396 tempest-VolumesTestJSON-801822396-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/98f95147-00d2-4f4d-b25e-d2a08c862914" status: 200 len: 351 microversion: 2.1 time: 0.158842 Sep 21 12:20:44.992016 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 6/10] 10.222.0.71 () {58 vars in 1245 bytes} [Wed Sep 21 12:20:44 2022] GET /compute/v2.1/os-volumes/98f95147-00d2-4f4d-b25e-d2a08c862914 => generated 351 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:20:45.008448 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-8e804923-f63f-4915-8942-a3a7e5c3a032 tempest-VolumesTestJSON-801822396 tempest-VolumesTestJSON-801822396-project] Calling method '.version_select at 0x7fe4c9dd23a0>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:20:45.250662 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-8e804923-f63f-4915-8942-a3a7e5c3a032 tempest-VolumesTestJSON-801822396 tempest-VolumesTestJSON-801822396-project] 10.222.0.71 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.256819 Sep 21 12:20:45.251582 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 5/11] 10.222.0.71 () {58 vars in 1134 bytes} [Wed Sep 21 12:20:44 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:20:45.270163 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-f13eabaf-03a9-4347-885a-867897634741 tempest-VolumesTestJSON-801822396 tempest-VolumesTestJSON-801822396-project] Calling method '.version_select at 0x7fe4c9ddcaf0>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:20:45.472549 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-f13eabaf-03a9-4347-885a-867897634741 tempest-VolumesTestJSON-801822396 tempest-VolumesTestJSON-801822396-project] 10.222.0.71 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.209013 Sep 21 12:20:45.473512 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 7/12] 10.222.0.71 () {58 vars in 1149 bytes} [Wed Sep 21 12:20:45 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:20:45.490179 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-dea0f07e-4cc5-4be7-aece-bb6a7b89313b tempest-VolumesTestJSON-801822396 tempest-VolumesTestJSON-801822396-project] Calling method '.version_select at 0x7fe4c9dd2ca0>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:20:45.731653 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-dea0f07e-4cc5-4be7-aece-bb6a7b89313b tempest-VolumesTestJSON-801822396 tempest-VolumesTestJSON-801822396-project] 10.222.0.71 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.246099 Sep 21 12:20:45.732263 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 6/13] 10.222.0.71 () {58 vars in 1134 bytes} [Wed Sep 21 12:20:45 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:20:45.754614 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-f394b674-a697-48ac-abd2-eccd4832107b tempest-VolumesTestJSON-801822396 tempest-VolumesTestJSON-801822396-project] Calling method '.version_select at 0x7fe4c9d6eca0>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:20:46.116371 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-f394b674-a697-48ac-abd2-eccd4832107b tempest-VolumesTestJSON-801822396 tempest-VolumesTestJSON-801822396-project] 10.222.0.71 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.365324 Sep 21 12:20:46.117034 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 8/14] 10.222.0.71 () {58 vars in 1167 bytes} [Wed Sep 21 12:20:45 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:20:46.144467 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-cf43a858-6913-419a-bc2c-e24e00715726 tempest-VolumesTestJSON-801822396 tempest-VolumesTestJSON-801822396-project] Calling method '.version_select at 0x7fe4c9de6700>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:20:46.347888 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-cf43a858-6913-419a-bc2c-e24e00715726 tempest-VolumesTestJSON-801822396 tempest-VolumesTestJSON-801822396-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.220173 Sep 21 12:20:46.348902 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 7/15] 10.222.0.71 () {58 vars in 1170 bytes} [Wed Sep 21 12:20:46 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:20:46.363861 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-0edc7f79-40ef-4136-97fc-9e91dda7fa50 tempest-VolumesTestJSON-801822396 tempest-VolumesTestJSON-801822396-project] Calling method '.version_select at 0x7fe4c9d6e820>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:20:46.585748 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-0edc7f79-40ef-4136-97fc-9e91dda7fa50 tempest-VolumesTestJSON-801822396 tempest-VolumesTestJSON-801822396-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.227064 Sep 21 12:20:46.586602 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 9/16] 10.222.0.71 () {58 vars in 1155 bytes} [Wed Sep 21 12:20:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:20:46.602575 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-e1577aa9-fc6e-4b9c-96dd-ef19424ea91f tempest-VolumesTestJSON-801822396 tempest-VolumesTestJSON-801822396-project] Calling method '.version_select at 0x7fe4c9de69d0>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:20:46.795877 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-e1577aa9-fc6e-4b9c-96dd-ef19424ea91f tempest-VolumesTestJSON-801822396 tempest-VolumesTestJSON-801822396-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.198778 Sep 21 12:20:46.796450 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 8/17] 10.222.0.71 () {58 vars in 1188 bytes} [Wed Sep 21 12:20:46 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:20:46.815165 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-47bebc01-18b6-4e4b-80d8-ca3aad2a25f6 tempest-VolumesTestJSON-801822396 tempest-VolumesTestJSON-801822396-project] Calling method '.version_select at 0x7fe4c9deaca0>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:20:47.047840 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-47bebc01-18b6-4e4b-80d8-ca3aad2a25f6 tempest-VolumesTestJSON-801822396 tempest-VolumesTestJSON-801822396-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.238173 Sep 21 12:20:47.048637 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 10/18] 10.222.0.71 () {58 vars in 1155 bytes} [Wed Sep 21 12:20:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:20:50.185866 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-858187ef-2492-40b1-a1e4-1cf2822892d2 tempest-VolumesNegativeTest-2005721642 tempest-VolumesNegativeTest-2005721642-project] Action: 'create', calling method: .version_select at 0x7fe4c9dd2790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1900154299", "metadata": {"Type": "work"}}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:20:50.214141 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-858187ef-2492-40b1-a1e4-1cf2822892d2 tempest-VolumesNegativeTest-2005721642 tempest-VolumesNegativeTest-2005721642-project] Request method failure captured: Sep 21 12:20:50.214141 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 21 12:20:50.214141 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept: application/json Sep 21 12:20:50.214141 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept-Encoding: identity Sep 21 12:20:50.214141 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Connection: close Sep 21 12:20:50.214141 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Length: 122 Sep 21 12:20:50.214141 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Type: application/json Sep 21 12:20:50.214141 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Host: 10.222.0.71 Sep 21 12:20:50.214141 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Openstack-System-Scope: None Sep 21 12:20:50.214141 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: User-Agent: python-urllib3/1.26.12 Sep 21 12:20:50.214141 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Auth-Token: gAAAAABjKwGhqrp3agzTGkZpaqRfll9GSZinyCslc1d5cXIekHPqMOo12J_vWf8xEMyaJCV5DOmIjeWARxm7873o2x5UO8KjSc6AoSYRpwyLw8FSg1LJpMb13Wd4FlJIUxxrfXAv8_YprbjHPnNAH7w0GUiOWqXFc5Kp3qtE1WmrHmQrKIo7hew Sep 21 12:20:50.214141 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Id: None Sep 21 12:20:50.214141 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Name: None Sep 21 12:20:50.214141 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Identity-Status: Confirmed Sep 21 12:20:50.214141 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Is-Admin-Project: True Sep 21 12:20:50.214141 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Id: default Sep 21 12:20:50.214141 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Name: Default Sep 21 12:20:50.214141 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Id: 94cc1c11f48c46f9abddda990eaf64e8 Sep 21 12:20:50.214141 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Name: tempest-VolumesNegativeTest-2005721642 Sep 21 12:20:50.214141 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Role: reader,member Sep 21 12:20:50.214141 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Roles: reader,member Sep 21 12:20:50.215459 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94cc1c11f48c46f9abddda990eaf64e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94cc1c11f48c46f9abddda990eaf64e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_94cc1c11f48c46f9abddda990eaf64e8", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/94cc1c11f48c46f9abddda990eaf64e8"}]}] Sep 21 12:20:50.215459 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant: tempest-VolumesNegativeTest-2005721642 Sep 21 12:20:50.215459 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Id: 94cc1c11f48c46f9abddda990eaf64e8 Sep 21 12:20:50.215459 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Name: tempest-VolumesNegativeTest-2005721642 Sep 21 12:20:50.215459 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User: tempest-VolumesNegativeTest-2005721642-project Sep 21 12:20:50.215459 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Id: default Sep 21 12:20:50.215459 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Name: Default Sep 21 12:20:50.215459 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Id: 21a25d78535c414d9080c6244fabeafd Sep 21 12:20:50.215459 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Name: tempest-VolumesNegativeTest-2005721642-project Sep 21 12:20:50.215459 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Sep 21 12:20:50.215459 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1900154299", "metadata": {"Type": "work"}}} Sep 21 12:20:50.215459 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: method: Sep 21 12:20:50.215459 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 21 12:20:50.216312 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1900154299', 'metadata': {'Type': 'work'}}}} Sep 21 12:20:50.216312 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:20:50.216312 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:20:50.216312 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 21 12:20:50.216312 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 21 12:20:50.216312 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 21 12:20:50.216312 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise error Sep 21 12:20:50.216312 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 21 12:20:50.216312 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.216312 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 21 12:20:50.216312 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 21 12:20:50.216312 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.216312 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 21 12:20:50.216312 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi '#$%' Sep 21 12:20:50.216312 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.216312 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:20:50.216312 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.216312 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:20:50.216312 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:20:50.216312 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:20:50.216312 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:20:50.216312 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:20:50.217945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 21 12:20:50.217945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 21 12:20:50.217945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:20:50.217945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:20:50.217945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 21 12:20:50.217945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 21 12:20:50.217945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 21 12:20:50.217945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 21 12:20:50.217945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 21 12:20:50.217945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 21 12:20:50.217945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 21 12:20:50.217945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.217945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:20:50.217945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.217945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:20:50.217945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:20:50.217945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:20:50.217945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 21 12:20:50.217945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 21 12:20:50.219354 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 21 12:20:50.219354 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.222002 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-858187ef-2492-40b1-a1e4-1cf2822892d2 tempest-VolumesNegativeTest-2005721642 tempest-VolumesNegativeTest-2005721642-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:20:50.225827 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-858187ef-2492-40b1-a1e4-1cf2822892d2 tempest-VolumesNegativeTest-2005721642 tempest-VolumesNegativeTest-2005721642-project] 10.222.0.71 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.763146 Sep 21 12:20:50.228545 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 9/19] 10.222.0.71 () {60 vars in 1156 bytes} [Wed Sep 21 12:20:49 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 767 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 21 12:20:50.244022 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-b984d1ae-5107-411f-8f97-64ccb4b2815b tempest-VolumesNegativeTest-2005721642 tempest-VolumesNegativeTest-2005721642-project] Action: 'create', calling method: .version_select at 0x7fe4c9d71310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1435642251", "metadata": {"Type": "work"}}} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:20:50.261824 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-b984d1ae-5107-411f-8f97-64ccb4b2815b tempest-VolumesNegativeTest-2005721642 tempest-VolumesNegativeTest-2005721642-project] Request method failure captured: Sep 21 12:20:50.261824 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 21 12:20:50.261824 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept: application/json Sep 21 12:20:50.261824 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept-Encoding: identity Sep 21 12:20:50.261824 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Connection: close Sep 21 12:20:50.261824 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Length: 120 Sep 21 12:20:50.261824 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Type: application/json Sep 21 12:20:50.261824 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Host: 10.222.0.71 Sep 21 12:20:50.261824 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Openstack-System-Scope: None Sep 21 12:20:50.261824 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: User-Agent: python-urllib3/1.26.12 Sep 21 12:20:50.261824 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Auth-Token: gAAAAABjKwGhqrp3agzTGkZpaqRfll9GSZinyCslc1d5cXIekHPqMOo12J_vWf8xEMyaJCV5DOmIjeWARxm7873o2x5UO8KjSc6AoSYRpwyLw8FSg1LJpMb13Wd4FlJIUxxrfXAv8_YprbjHPnNAH7w0GUiOWqXFc5Kp3qtE1WmrHmQrKIo7hew Sep 21 12:20:50.261824 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Id: None Sep 21 12:20:50.261824 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Name: None Sep 21 12:20:50.261824 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Identity-Status: Confirmed Sep 21 12:20:50.261824 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Is-Admin-Project: True Sep 21 12:20:50.261824 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Id: default Sep 21 12:20:50.261824 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Name: Default Sep 21 12:20:50.261824 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Id: 94cc1c11f48c46f9abddda990eaf64e8 Sep 21 12:20:50.261824 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Name: tempest-VolumesNegativeTest-2005721642 Sep 21 12:20:50.261824 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Role: reader,member Sep 21 12:20:50.261824 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Roles: reader,member Sep 21 12:20:50.263111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94cc1c11f48c46f9abddda990eaf64e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94cc1c11f48c46f9abddda990eaf64e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_94cc1c11f48c46f9abddda990eaf64e8", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/94cc1c11f48c46f9abddda990eaf64e8"}]}] Sep 21 12:20:50.263111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant: tempest-VolumesNegativeTest-2005721642 Sep 21 12:20:50.263111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Id: 94cc1c11f48c46f9abddda990eaf64e8 Sep 21 12:20:50.263111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Name: tempest-VolumesNegativeTest-2005721642 Sep 21 12:20:50.263111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User: tempest-VolumesNegativeTest-2005721642-project Sep 21 12:20:50.263111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Id: default Sep 21 12:20:50.263111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Name: Default Sep 21 12:20:50.263111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Id: 21a25d78535c414d9080c6244fabeafd Sep 21 12:20:50.263111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Name: tempest-VolumesNegativeTest-2005721642-project Sep 21 12:20:50.263111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Sep 21 12:20:50.263111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1435642251", "metadata": {"Type": "work"}}} Sep 21 12:20:50.263111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: method: Sep 21 12:20:50.263111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 21 12:20:50.263843 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1435642251', 'metadata': {'Type': 'work'}}}} Sep 21 12:20:50.263843 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:20:50.263843 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:20:50.263843 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 21 12:20:50.263843 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 21 12:20:50.263843 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 21 12:20:50.263843 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise error Sep 21 12:20:50.263843 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 21 12:20:50.263843 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.263843 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 21 12:20:50.263843 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 21 12:20:50.263843 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.263843 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 21 12:20:50.263843 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi '0' Sep 21 12:20:50.263843 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.263843 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:20:50.263843 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.263843 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:20:50.263843 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:20:50.263843 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:20:50.263843 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:20:50.263843 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:20:50.265037 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 21 12:20:50.265037 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 21 12:20:50.265037 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:20:50.265037 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:20:50.265037 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 21 12:20:50.265037 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 21 12:20:50.265037 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 21 12:20:50.265037 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 21 12:20:50.265037 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 21 12:20:50.265037 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 21 12:20:50.265037 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 21 12:20:50.265037 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.265037 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:20:50.265037 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.265037 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:20:50.265037 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:20:50.265037 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:20:50.265037 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 21 12:20:50.265037 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 21 12:20:50.266623 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 21 12:20:50.266623 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.269125 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-b984d1ae-5107-411f-8f97-64ccb4b2815b tempest-VolumesNegativeTest-2005721642 tempest-VolumesNegativeTest-2005721642-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:20:50.272650 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-b984d1ae-5107-411f-8f97-64ccb4b2815b tempest-VolumesNegativeTest-2005721642 tempest-VolumesNegativeTest-2005721642-project] 10.222.0.71 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.037627 Sep 21 12:20:50.275899 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 11/20] 10.222.0.71 () {60 vars in 1156 bytes} [Wed Sep 21 12:20:50 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 21 12:20:50.287518 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-e9f5a492-a9c9-476f-90bf-7c0bdd53ff18 tempest-VolumesNegativeTest-2005721642 tempest-VolumesNegativeTest-2005721642-project] Action: 'create', calling method: .version_select at 0x7fe4c9de68b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1774001078", "metadata": {"Type": "work"}}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:20:50.294305 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-e9f5a492-a9c9-476f-90bf-7c0bdd53ff18 tempest-VolumesNegativeTest-2005721642 tempest-VolumesNegativeTest-2005721642-project] Request method failure captured: Sep 21 12:20:50.294305 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 21 12:20:50.294305 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept: application/json Sep 21 12:20:50.294305 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept-Encoding: identity Sep 21 12:20:50.294305 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Connection: close Sep 21 12:20:50.294305 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Length: 119 Sep 21 12:20:50.294305 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Type: application/json Sep 21 12:20:50.294305 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Host: 10.222.0.71 Sep 21 12:20:50.294305 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Openstack-System-Scope: None Sep 21 12:20:50.294305 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: User-Agent: python-urllib3/1.26.12 Sep 21 12:20:50.294305 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Auth-Token: gAAAAABjKwGhqrp3agzTGkZpaqRfll9GSZinyCslc1d5cXIekHPqMOo12J_vWf8xEMyaJCV5DOmIjeWARxm7873o2x5UO8KjSc6AoSYRpwyLw8FSg1LJpMb13Wd4FlJIUxxrfXAv8_YprbjHPnNAH7w0GUiOWqXFc5Kp3qtE1WmrHmQrKIo7hew Sep 21 12:20:50.294305 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Id: None Sep 21 12:20:50.294305 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Name: None Sep 21 12:20:50.294305 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Identity-Status: Confirmed Sep 21 12:20:50.294305 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Is-Admin-Project: True Sep 21 12:20:50.294305 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Id: default Sep 21 12:20:50.294305 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Name: Default Sep 21 12:20:50.294305 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Id: 94cc1c11f48c46f9abddda990eaf64e8 Sep 21 12:20:50.294305 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Name: tempest-VolumesNegativeTest-2005721642 Sep 21 12:20:50.294305 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Role: reader,member Sep 21 12:20:50.294305 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Roles: reader,member Sep 21 12:20:50.296736 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94cc1c11f48c46f9abddda990eaf64e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94cc1c11f48c46f9abddda990eaf64e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_94cc1c11f48c46f9abddda990eaf64e8", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/94cc1c11f48c46f9abddda990eaf64e8"}]}] Sep 21 12:20:50.296736 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant: tempest-VolumesNegativeTest-2005721642 Sep 21 12:20:50.296736 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Id: 94cc1c11f48c46f9abddda990eaf64e8 Sep 21 12:20:50.296736 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Name: tempest-VolumesNegativeTest-2005721642 Sep 21 12:20:50.296736 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User: tempest-VolumesNegativeTest-2005721642-project Sep 21 12:20:50.296736 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Id: default Sep 21 12:20:50.296736 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Name: Default Sep 21 12:20:50.296736 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Id: 21a25d78535c414d9080c6244fabeafd Sep 21 12:20:50.296736 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Name: tempest-VolumesNegativeTest-2005721642-project Sep 21 12:20:50.296736 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Sep 21 12:20:50.296736 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1774001078", "metadata": {"Type": "work"}}} Sep 21 12:20:50.296736 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: method: Sep 21 12:20:50.296736 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 21 12:20:50.297565 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1774001078', 'metadata': {'Type': 'work'}}}} Sep 21 12:20:50.297565 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:20:50.297565 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:20:50.297565 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 21 12:20:50.297565 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 21 12:20:50.297565 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 21 12:20:50.297565 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise error Sep 21 12:20:50.297565 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 21 12:20:50.297565 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.297565 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 21 12:20:50.297565 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 21 12:20:50.297565 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.297565 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 21 12:20:50.297565 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi '' Sep 21 12:20:50.297565 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.297565 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:20:50.297565 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.297565 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:20:50.297565 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:20:50.297565 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:20:50.297565 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:20:50.297565 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:20:50.299361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 21 12:20:50.299361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 21 12:20:50.299361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:20:50.299361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:20:50.299361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 21 12:20:50.299361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 21 12:20:50.299361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 21 12:20:50.299361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 21 12:20:50.299361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 21 12:20:50.299361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 21 12:20:50.299361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 21 12:20:50.299361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.299361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:20:50.299361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.299361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:20:50.299361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:20:50.299361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:20:50.299361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 21 12:20:50.299361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 21 12:20:50.300597 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 21 12:20:50.300597 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.303816 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-e9f5a492-a9c9-476f-90bf-7c0bdd53ff18 tempest-VolumesNegativeTest-2005721642 tempest-VolumesNegativeTest-2005721642-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:20:50.307428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-e9f5a492-a9c9-476f-90bf-7c0bdd53ff18 tempest-VolumesNegativeTest-2005721642 tempest-VolumesNegativeTest-2005721642-project] 10.222.0.71 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.023813 Sep 21 12:20:50.309883 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 10/21] 10.222.0.71 () {60 vars in 1156 bytes} [Wed Sep 21 12:20:50 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 21 12:20:50.320338 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-73d75c6c-e77b-412a-812e-edd6ecf1df28 tempest-VolumesNegativeTest-2005721642 tempest-VolumesNegativeTest-2005721642-project] Calling method '.version_select at 0x7fe4c9dead30>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:20:50.384097 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.wsgi [None req-73d75c6c-e77b-412a-812e-edd6ecf1df28 tempest-VolumesNegativeTest-2005721642 tempest-VolumesNegativeTest-2005721642-project] HTTP exception thrown: Volume tempest-invalid-2000880549 could not be found. Sep 21 12:20:50.386826 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-73d75c6c-e77b-412a-812e-edd6ecf1df28 tempest-VolumesNegativeTest-2005721642 tempest-VolumesNegativeTest-2005721642-project] Request method failure captured: Sep 21 12:20:50.386826 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2000880549 HTTP/1.1 Sep 21 12:20:50.386826 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept: application/json Sep 21 12:20:50.386826 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept-Encoding: identity Sep 21 12:20:50.386826 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Connection: close Sep 21 12:20:50.386826 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Length: 0 Sep 21 12:20:50.386826 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Type: application/json Sep 21 12:20:50.386826 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Host: 10.222.0.71 Sep 21 12:20:50.386826 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Openstack-System-Scope: None Sep 21 12:20:50.386826 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: User-Agent: python-urllib3/1.26.12 Sep 21 12:20:50.386826 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Auth-Token: gAAAAABjKwGhqrp3agzTGkZpaqRfll9GSZinyCslc1d5cXIekHPqMOo12J_vWf8xEMyaJCV5DOmIjeWARxm7873o2x5UO8KjSc6AoSYRpwyLw8FSg1LJpMb13Wd4FlJIUxxrfXAv8_YprbjHPnNAH7w0GUiOWqXFc5Kp3qtE1WmrHmQrKIo7hew Sep 21 12:20:50.386826 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Id: None Sep 21 12:20:50.386826 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Name: None Sep 21 12:20:50.386826 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Identity-Status: Confirmed Sep 21 12:20:50.386826 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Is-Admin-Project: True Sep 21 12:20:50.386826 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Id: default Sep 21 12:20:50.386826 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Name: Default Sep 21 12:20:50.386826 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Id: 94cc1c11f48c46f9abddda990eaf64e8 Sep 21 12:20:50.386826 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Name: tempest-VolumesNegativeTest-2005721642 Sep 21 12:20:50.386826 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Role: reader,member Sep 21 12:20:50.386826 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Roles: reader,member Sep 21 12:20:50.388065 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94cc1c11f48c46f9abddda990eaf64e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94cc1c11f48c46f9abddda990eaf64e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_94cc1c11f48c46f9abddda990eaf64e8", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/94cc1c11f48c46f9abddda990eaf64e8"}]}] Sep 21 12:20:50.388065 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant: tempest-VolumesNegativeTest-2005721642 Sep 21 12:20:50.388065 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Id: 94cc1c11f48c46f9abddda990eaf64e8 Sep 21 12:20:50.388065 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Name: tempest-VolumesNegativeTest-2005721642 Sep 21 12:20:50.388065 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User: tempest-VolumesNegativeTest-2005721642-project Sep 21 12:20:50.388065 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Id: default Sep 21 12:20:50.388065 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Name: Default Sep 21 12:20:50.388065 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Id: 21a25d78535c414d9080c6244fabeafd Sep 21 12:20:50.388065 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Name: tempest-VolumesNegativeTest-2005721642-project Sep 21 12:20:50.388065 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: method: Sep 21 12:20:50.388065 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: exception: Volume tempest-invalid-2000880549 could not be found. Sep 21 12:20:50.388065 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: action_args: {'id': 'tempest-invalid-2000880549'} Sep 21 12:20:50.388065 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:20:50.388811 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:20:50.388811 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 21 12:20:50.388811 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 21 12:20:50.388811 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 21 12:20:50.388811 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 21 12:20:50.388811 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 21 12:20:50.388811 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 21 12:20:50.388811 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 21 12:20:50.388811 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 21 12:20:50.388811 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 21 12:20:50.388811 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 21 12:20:50.388811 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 21 12:20:50.388811 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 21 12:20:50.388811 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 21 12:20:50.388811 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 21 12:20:50.388811 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2000880549 could not be found. (HTTP 404) (Request-ID: req-143b63d6-4678-48d8-9cde-799077c9b419) Sep 21 12:20:50.388811 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.388811 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:20:50.388811 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.390522 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:20:50.390522 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 21 12:20:50.390522 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 21 12:20:50.390522 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 21 12:20:50.390522 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 21 12:20:50.390522 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 21 12:20:50.390522 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 21 12:20:50.390522 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 21 12:20:50.390522 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 21 12:20:50.390522 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 21 12:20:50.390522 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 21 12:20:50.390522 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 21 12:20:50.390522 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 21 12:20:50.390522 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 21 12:20:50.390522 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 21 12:20:50.390522 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 21 12:20:50.390522 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 21 12:20:50.390522 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 21 12:20:50.390522 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 21 12:20:50.391408 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 21 12:20:50.391408 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 21 12:20:50.391408 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 21 12:20:50.391408 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 21 12:20:50.391408 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2000880549 could not be found. Sep 21 12:20:50.391408 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.391408 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:20:50.391408 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.391408 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:20:50.391408 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:20:50.391408 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:20:50.391408 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:20:50.391408 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:20:50.391408 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 21 12:20:50.391408 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 21 12:20:50.391408 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:20:50.391408 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:20:50.391408 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 21 12:20:50.391408 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:20:50.391408 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2000880549 could not be found. Sep 21 12:20:50.392397 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.392397 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:20:50.392397 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.392397 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:20:50.392397 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:20:50.392397 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:20:50.392397 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:20:50.392397 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:20:50.392397 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2000880549 could not be found. Sep 21 12:20:50.392397 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.392397 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-73d75c6c-e77b-412a-812e-edd6ecf1df28 tempest-VolumesNegativeTest-2005721642 tempest-VolumesNegativeTest-2005721642-project] Returning 404 to user: Volume tempest-invalid-2000880549 could not be found. {{(pid=120462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:20:50.392397 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-73d75c6c-e77b-412a-812e-edd6ecf1df28 tempest-VolumesNegativeTest-2005721642 tempest-VolumesNegativeTest-2005721642-project] 10.222.0.71 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2000880549" status: 404 len: 99 microversion: 2.1 time: 0.072713 Sep 21 12:20:50.400448 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-4ba5ce1a-1ed1-4927-a896-851113f60df9 tempest-VolumesNegativeTest-2005721642 tempest-VolumesNegativeTest-2005721642-project] 10.222.0.71 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004182 Sep 21 12:20:50.401308 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 11/22] 10.222.0.71 () {58 vars in 1140 bytes} [Wed Sep 21 12:20:50 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 21 12:20:50.401568 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 12/23] 10.222.0.71 () {58 vars in 1218 bytes} [Wed Sep 21 12:20:50 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2000880549 => generated 99 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 21 12:20:50.412208 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-d216d76c-1613-4b4c-99f2-418fea41ecd5 tempest-VolumesNegativeTest-2005721642 tempest-VolumesNegativeTest-2005721642-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005271 Sep 21 12:20:50.425502 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 12/24] 10.222.0.71 () {58 vars in 1137 bytes} [Wed Sep 21 12:20:50 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 21 12:20:50.425711 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-355f5421-0fd2-4c01-9590-0673a4c819f2 tempest-VolumesNegativeTest-2005721642 tempest-VolumesNegativeTest-2005721642-project] Calling method '.version_select at 0x7fe4c9deab80>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:20:50.478549 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.wsgi [None req-355f5421-0fd2-4c01-9590-0673a4c819f2 tempest-VolumesNegativeTest-2005721642 tempest-VolumesNegativeTest-2005721642-project] HTTP exception thrown: Volume 9a41f3b9-33d8-4d43-a593-19fd8b9d5e20 could not be found. Sep 21 12:20:50.480954 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-355f5421-0fd2-4c01-9590-0673a4c819f2 tempest-VolumesNegativeTest-2005721642 tempest-VolumesNegativeTest-2005721642-project] Request method failure captured: Sep 21 12:20:50.480954 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: request: DELETE /compute/v2.1/os-volumes/9a41f3b9-33d8-4d43-a593-19fd8b9d5e20 HTTP/1.1 Sep 21 12:20:50.480954 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept: application/json Sep 21 12:20:50.480954 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept-Encoding: identity Sep 21 12:20:50.480954 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Connection: close Sep 21 12:20:50.480954 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Length: 0 Sep 21 12:20:50.480954 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Type: application/json Sep 21 12:20:50.480954 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Host: 10.222.0.71 Sep 21 12:20:50.480954 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Openstack-System-Scope: None Sep 21 12:20:50.480954 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: User-Agent: python-urllib3/1.26.12 Sep 21 12:20:50.480954 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Auth-Token: gAAAAABjKwGhqrp3agzTGkZpaqRfll9GSZinyCslc1d5cXIekHPqMOo12J_vWf8xEMyaJCV5DOmIjeWARxm7873o2x5UO8KjSc6AoSYRpwyLw8FSg1LJpMb13Wd4FlJIUxxrfXAv8_YprbjHPnNAH7w0GUiOWqXFc5Kp3qtE1WmrHmQrKIo7hew Sep 21 12:20:50.480954 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Id: None Sep 21 12:20:50.480954 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Name: None Sep 21 12:20:50.480954 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Identity-Status: Confirmed Sep 21 12:20:50.480954 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Is-Admin-Project: True Sep 21 12:20:50.480954 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Id: default Sep 21 12:20:50.480954 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Name: Default Sep 21 12:20:50.480954 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Id: 94cc1c11f48c46f9abddda990eaf64e8 Sep 21 12:20:50.480954 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Name: tempest-VolumesNegativeTest-2005721642 Sep 21 12:20:50.480954 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Role: reader,member Sep 21 12:20:50.480954 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Roles: reader,member Sep 21 12:20:50.482023 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94cc1c11f48c46f9abddda990eaf64e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94cc1c11f48c46f9abddda990eaf64e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_94cc1c11f48c46f9abddda990eaf64e8", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/94cc1c11f48c46f9abddda990eaf64e8"}]}] Sep 21 12:20:50.482023 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant: tempest-VolumesNegativeTest-2005721642 Sep 21 12:20:50.482023 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Id: 94cc1c11f48c46f9abddda990eaf64e8 Sep 21 12:20:50.482023 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Name: tempest-VolumesNegativeTest-2005721642 Sep 21 12:20:50.482023 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User: tempest-VolumesNegativeTest-2005721642-project Sep 21 12:20:50.482023 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Id: default Sep 21 12:20:50.482023 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Name: Default Sep 21 12:20:50.482023 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Id: 21a25d78535c414d9080c6244fabeafd Sep 21 12:20:50.482023 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Name: tempest-VolumesNegativeTest-2005721642-project Sep 21 12:20:50.482023 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: method: Sep 21 12:20:50.482023 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: exception: Volume 9a41f3b9-33d8-4d43-a593-19fd8b9d5e20 could not be found. Sep 21 12:20:50.482023 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: action_args: {'id': '9a41f3b9-33d8-4d43-a593-19fd8b9d5e20'} Sep 21 12:20:50.482023 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:20:50.482678 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:20:50.482678 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 21 12:20:50.482678 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 21 12:20:50.482678 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 21 12:20:50.482678 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 21 12:20:50.482678 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 21 12:20:50.482678 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 21 12:20:50.482678 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 21 12:20:50.482678 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 21 12:20:50.482678 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 21 12:20:50.482678 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 21 12:20:50.482678 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 21 12:20:50.482678 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 21 12:20:50.482678 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 21 12:20:50.482678 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 21 12:20:50.482678 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9a41f3b9-33d8-4d43-a593-19fd8b9d5e20 could not be found. (HTTP 404) (Request-ID: req-15fd8f03-851f-48db-8487-a5aa52184d0f) Sep 21 12:20:50.482678 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.482678 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:20:50.482678 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.484201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:20:50.484201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 21 12:20:50.484201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 21 12:20:50.484201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 21 12:20:50.484201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 21 12:20:50.484201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 21 12:20:50.484201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 21 12:20:50.484201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 21 12:20:50.484201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 21 12:20:50.484201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 21 12:20:50.484201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 21 12:20:50.484201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 21 12:20:50.484201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 21 12:20:50.484201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 21 12:20:50.484201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 21 12:20:50.484201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 21 12:20:50.484201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 21 12:20:50.484201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 21 12:20:50.484201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 21 12:20:50.485080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 21 12:20:50.485080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 21 12:20:50.485080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 21 12:20:50.485080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 21 12:20:50.485080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9a41f3b9-33d8-4d43-a593-19fd8b9d5e20 could not be found. Sep 21 12:20:50.485080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.485080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:20:50.485080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.485080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:20:50.485080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:20:50.485080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:20:50.485080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:20:50.485080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:20:50.485080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 21 12:20:50.485080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 21 12:20:50.485080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:20:50.485080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:20:50.485080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 21 12:20:50.485080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:20:50.490574 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9a41f3b9-33d8-4d43-a593-19fd8b9d5e20 could not be found. Sep 21 12:20:50.490574 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.490574 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:20:50.490574 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.490574 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:20:50.490574 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:20:50.490574 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:20:50.490574 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:20:50.490574 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:20:50.490574 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9a41f3b9-33d8-4d43-a593-19fd8b9d5e20 could not be found. Sep 21 12:20:50.490574 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.490574 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-355f5421-0fd2-4c01-9590-0673a4c819f2 tempest-VolumesNegativeTest-2005721642 tempest-VolumesNegativeTest-2005721642-project] Returning 404 to user: Volume 9a41f3b9-33d8-4d43-a593-19fd8b9d5e20 could not be found. {{(pid=120462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:20:50.490574 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-355f5421-0fd2-4c01-9590-0673a4c819f2 tempest-VolumesNegativeTest-2005721642 tempest-VolumesNegativeTest-2005721642-project] 10.222.0.71 "DELETE /compute/v2.1/os-volumes/9a41f3b9-33d8-4d43-a593-19fd8b9d5e20" status: 404 len: 109 microversion: 2.1 time: 0.064551 Sep 21 12:20:50.490574 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 13/25] 10.222.0.71 () {58 vars in 1248 bytes} [Wed Sep 21 12:20:50 2022] DELETE /compute/v2.1/os-volumes/9a41f3b9-33d8-4d43-a593-19fd8b9d5e20 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:20:50.494764 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-87534fef-f4dd-4fd4-a229-7d79b2fa14ad tempest-VolumesNegativeTest-2005721642 tempest-VolumesNegativeTest-2005721642-project] Calling method '.version_select at 0x7fe4c9de6280>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:20:50.540562 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.wsgi [None req-87534fef-f4dd-4fd4-a229-7d79b2fa14ad tempest-VolumesNegativeTest-2005721642 tempest-VolumesNegativeTest-2005721642-project] HTTP exception thrown: Volume ddc0f4f7-43a2-4f2e-b34e-6282e4613823 could not be found. Sep 21 12:20:50.544151 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-87534fef-f4dd-4fd4-a229-7d79b2fa14ad tempest-VolumesNegativeTest-2005721642 tempest-VolumesNegativeTest-2005721642-project] Request method failure captured: Sep 21 12:20:50.544151 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: request: GET /compute/v2.1/os-volumes/ddc0f4f7-43a2-4f2e-b34e-6282e4613823 HTTP/1.1 Sep 21 12:20:50.544151 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept: application/json Sep 21 12:20:50.544151 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept-Encoding: identity Sep 21 12:20:50.544151 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Connection: close Sep 21 12:20:50.544151 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Length: 0 Sep 21 12:20:50.544151 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Type: application/json Sep 21 12:20:50.544151 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Host: 10.222.0.71 Sep 21 12:20:50.544151 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Openstack-System-Scope: None Sep 21 12:20:50.544151 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: User-Agent: python-urllib3/1.26.12 Sep 21 12:20:50.544151 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Auth-Token: gAAAAABjKwGhqrp3agzTGkZpaqRfll9GSZinyCslc1d5cXIekHPqMOo12J_vWf8xEMyaJCV5DOmIjeWARxm7873o2x5UO8KjSc6AoSYRpwyLw8FSg1LJpMb13Wd4FlJIUxxrfXAv8_YprbjHPnNAH7w0GUiOWqXFc5Kp3qtE1WmrHmQrKIo7hew Sep 21 12:20:50.544151 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Id: None Sep 21 12:20:50.544151 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Name: None Sep 21 12:20:50.544151 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Identity-Status: Confirmed Sep 21 12:20:50.544151 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Is-Admin-Project: True Sep 21 12:20:50.544151 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Id: default Sep 21 12:20:50.544151 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Name: Default Sep 21 12:20:50.544151 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Id: 94cc1c11f48c46f9abddda990eaf64e8 Sep 21 12:20:50.544151 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Name: tempest-VolumesNegativeTest-2005721642 Sep 21 12:20:50.544151 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Role: reader,member Sep 21 12:20:50.544151 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Roles: reader,member Sep 21 12:20:50.545395 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94cc1c11f48c46f9abddda990eaf64e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94cc1c11f48c46f9abddda990eaf64e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_94cc1c11f48c46f9abddda990eaf64e8", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/94cc1c11f48c46f9abddda990eaf64e8"}]}] Sep 21 12:20:50.545395 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant: tempest-VolumesNegativeTest-2005721642 Sep 21 12:20:50.545395 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Id: 94cc1c11f48c46f9abddda990eaf64e8 Sep 21 12:20:50.545395 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Name: tempest-VolumesNegativeTest-2005721642 Sep 21 12:20:50.545395 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User: tempest-VolumesNegativeTest-2005721642-project Sep 21 12:20:50.545395 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Id: default Sep 21 12:20:50.545395 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Name: Default Sep 21 12:20:50.545395 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Id: 21a25d78535c414d9080c6244fabeafd Sep 21 12:20:50.545395 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Name: tempest-VolumesNegativeTest-2005721642-project Sep 21 12:20:50.545395 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: method: Sep 21 12:20:50.545395 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: exception: Volume ddc0f4f7-43a2-4f2e-b34e-6282e4613823 could not be found. Sep 21 12:20:50.545395 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: action_args: {'id': 'ddc0f4f7-43a2-4f2e-b34e-6282e4613823'} Sep 21 12:20:50.545395 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:20:50.546700 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:20:50.546700 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 21 12:20:50.546700 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 21 12:20:50.546700 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 21 12:20:50.546700 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 21 12:20:50.546700 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 21 12:20:50.546700 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 21 12:20:50.546700 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 21 12:20:50.546700 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 21 12:20:50.546700 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 21 12:20:50.546700 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 21 12:20:50.546700 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 21 12:20:50.546700 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 21 12:20:50.546700 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 21 12:20:50.546700 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 21 12:20:50.546700 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ddc0f4f7-43a2-4f2e-b34e-6282e4613823 could not be found. (HTTP 404) (Request-ID: req-1413a71f-36c9-4aa7-b656-ebc9de8193e8) Sep 21 12:20:50.546700 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.546700 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:20:50.546700 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.547796 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:20:50.547796 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 21 12:20:50.547796 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 21 12:20:50.547796 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 21 12:20:50.547796 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 21 12:20:50.547796 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 21 12:20:50.547796 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 21 12:20:50.547796 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 21 12:20:50.547796 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 21 12:20:50.547796 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 21 12:20:50.547796 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 21 12:20:50.547796 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 21 12:20:50.547796 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 21 12:20:50.547796 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 21 12:20:50.547796 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 21 12:20:50.547796 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 21 12:20:50.547796 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 21 12:20:50.547796 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 21 12:20:50.547796 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 21 12:20:50.548932 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 21 12:20:50.548932 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 21 12:20:50.548932 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 21 12:20:50.548932 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 21 12:20:50.548932 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ddc0f4f7-43a2-4f2e-b34e-6282e4613823 could not be found. Sep 21 12:20:50.548932 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.548932 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:20:50.548932 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.548932 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:20:50.548932 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:20:50.548932 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:20:50.548932 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:20:50.548932 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:20:50.548932 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 21 12:20:50.548932 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 21 12:20:50.548932 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:20:50.548932 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:20:50.548932 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 21 12:20:50.548932 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:20:50.549942 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ddc0f4f7-43a2-4f2e-b34e-6282e4613823 could not be found. Sep 21 12:20:50.549942 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.549942 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:20:50.549942 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.549942 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:20:50.549942 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:20:50.549942 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:20:50.549942 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:20:50.549942 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:20:50.549942 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ddc0f4f7-43a2-4f2e-b34e-6282e4613823 could not be found. Sep 21 12:20:50.549942 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:20:50.549942 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-87534fef-f4dd-4fd4-a229-7d79b2fa14ad tempest-VolumesNegativeTest-2005721642 tempest-VolumesNegativeTest-2005721642-project] Returning 404 to user: Volume ddc0f4f7-43a2-4f2e-b34e-6282e4613823 could not be found. {{(pid=120463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:20:50.549942 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-87534fef-f4dd-4fd4-a229-7d79b2fa14ad tempest-VolumesNegativeTest-2005721642 tempest-VolumesNegativeTest-2005721642-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/ddc0f4f7-43a2-4f2e-b34e-6282e4613823" status: 404 len: 109 microversion: 2.1 time: 0.055450 Sep 21 12:20:50.549942 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 13/26] 10.222.0.71 () {58 vars in 1245 bytes} [Wed Sep 21 12:20:50 2022] GET /compute/v2.1/os-volumes/ddc0f4f7-43a2-4f2e-b34e-6282e4613823 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:20:50.839426 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-3ac1b70c-8a57-4443-8c0b-73450599f10b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Action: 'create', calling method: .version_select at 0x7fe4c9ddcb80>, body: {"keypair": {"name": "tempest-keypair-1299598923", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIuajvVOIe7qIUmW18MoWWBiYXmnKf9+a+pG5nwbtieC2KHZyrWXBcMVjFQ5Hc4MSj1LNAmTJubF2m3ysx7lj728QJYthMUBSNJhlS7j+Ydwno5PKsf5rsuqoW+r+GexQ=="}} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:20:50.947196 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-3ac1b70c-8a57-4443-8c0b-73450599f10b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Getting quotas for project 5e6ef4f3de1943ffbde82d3f0a19542f. Resources: {'key_pairs'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 12:20:50.962352 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-3ac1b70c-8a57-4443-8c0b-73450599f10b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Getting quotas for user c950eb00b9474b29b86d24983e3b1583 and project 5e6ef4f3de1943ffbde82d3f0a19542f. Resources: {'key_pairs'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 12:20:51.079079 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-3ac1b70c-8a57-4443-8c0b-73450599f10b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.503058 Sep 21 12:20:51.079691 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 14/27] 10.222.0.71 () {62 vars in 1200 bytes} [Wed Sep 21 12:20:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 504 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 21 12:20:56.329480 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-ccbdabff-a40a-4107-9717-1a5e06cbacbd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-144294370", "imageRef": "1e3a8d95-6338-499c-af91-e3d1345af950", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b3f0e30c-c130-4bd6-a99c-2726089c3f25"}], "security_groups": [{"name": "tempest-securitygroup--2039754061"}], "key_name": "tempest-keypair-1299598923", "user_data": "}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:20:56.812556 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.network.neutron [None req-ccbdabff-a40a-4107-9717-1a5e06cbacbd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] validate_networks() for [('b3f0e30c-c130-4bd6-a99c-2726089c3f25', None, None, None, None, None)] {{(pid=120463) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 12:20:57.100839 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-e61bce23-8087-472b-a1f5-cc289629f4bd tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1400302266", "imageRef": "1e3a8d95-6338-499c-af91-e3d1345af950", "flavorRef": "452", "networks": [{"uuid": "b63f4162-66af-473e-9153-2acb9ad38029"}]}} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:20:57.337490 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.network.neutron [None req-e61bce23-8087-472b-a1f5-cc289629f4bd tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] validate_networks() for [('b63f4162-66af-473e-9153-2acb9ad38029', None, None, None, None, None)] {{(pid=120462) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 12:20:59.473780 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-ccbdabff-a40a-4107-9717-1a5e06cbacbd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Flavor limits 0:0:0 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 12:20:59.476688 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-ccbdabff-a40a-4107-9717-1a5e06cbacbd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Image limits 0:0:0 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 12:20:59.477383 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-ccbdabff-a40a-4107-9717-1a5e06cbacbd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Flavor pref 0:0:0 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 12:20:59.477844 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-ccbdabff-a40a-4107-9717-1a5e06cbacbd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Image pref 0:0:0 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 12:20:59.478544 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-ccbdabff-a40a-4107-9717-1a5e06cbacbd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 12:20:59.522477 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ccbdabff-a40a-4107-9717-1a5e06cbacbd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:20:59.523123 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ccbdabff-a40a-4107-9717-1a5e06cbacbd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:20:59.523681 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ccbdabff-a40a-4107-9717-1a5e06cbacbd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:20:59.524559 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ccbdabff-a40a-4107-9717-1a5e06cbacbd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:20:59.525846 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ccbdabff-a40a-4107-9717-1a5e06cbacbd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:20:59.527881 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ccbdabff-a40a-4107-9717-1a5e06cbacbd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:20:59.539240 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-e61bce23-8087-472b-a1f5-cc289629f4bd tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Flavor limits 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 12:20:59.540491 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-e61bce23-8087-472b-a1f5-cc289629f4bd tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Image limits 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 12:20:59.541985 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-e61bce23-8087-472b-a1f5-cc289629f4bd tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Flavor pref 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 12:20:59.542629 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-e61bce23-8087-472b-a1f5-cc289629f4bd tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Image pref 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 12:20:59.543258 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-e61bce23-8087-472b-a1f5-cc289629f4bd tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 12:20:59.564979 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e61bce23-8087-472b-a1f5-cc289629f4bd tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:20:59.565829 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e61bce23-8087-472b-a1f5-cc289629f4bd tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:20:59.566878 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e61bce23-8087-472b-a1f5-cc289629f4bd tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:20:59.567924 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e61bce23-8087-472b-a1f5-cc289629f4bd tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:20:59.569079 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e61bce23-8087-472b-a1f5-cc289629f4bd tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:20:59.573233 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e61bce23-8087-472b-a1f5-cc289629f4bd tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:20:59.618460 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.quota [None req-ccbdabff-a40a-4107-9717-1a5e06cbacbd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Getting quotas for project 5e6ef4f3de1943ffbde82d3f0a19542f. Resources: {'instances', 'ram', 'cores'} {{(pid=120463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 12:20:59.631842 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-e61bce23-8087-472b-a1f5-cc289629f4bd tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Getting quotas for project 74d5d713723f4ea5a8d1e72627b80c47. Resources: {'instances', 'ram', 'cores'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 12:20:59.665588 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.quota [None req-ccbdabff-a40a-4107-9717-1a5e06cbacbd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Getting quotas for user c950eb00b9474b29b86d24983e3b1583 and project 5e6ef4f3de1943ffbde82d3f0a19542f. Resources: {'instances', 'ram', 'cores'} {{(pid=120463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 12:20:59.671354 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-e61bce23-8087-472b-a1f5-cc289629f4bd tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Getting quotas for user 2ab0433dd3864867b03c5dd6407aa388 and project 74d5d713723f4ea5a8d1e72627b80c47. Resources: {'instances', 'ram', 'cores'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 12:20:59.724273 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-ccbdabff-a40a-4107-9717-1a5e06cbacbd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Going to run 1 instances... {{(pid=120463) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 12:20:59.739317 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-ccbdabff-a40a-4107-9717-1a5e06cbacbd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e3a8d95-6338-499c-af91-e3d1345af950',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 12:20:59.765754 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-e61bce23-8087-472b-a1f5-cc289629f4bd tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Going to run 1 instances... {{(pid=120462) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 12:20:59.773546 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-e61bce23-8087-472b-a1f5-cc289629f4bd tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e3a8d95-6338-499c-af91-e3d1345af950',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 12:20:59.971414 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-ccbdabff-a40a-4107-9717-1a5e06cbacbd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.658549 Sep 21 12:20:59.978390 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 14/28] 10.222.0.71 () {62 vars in 1188 bytes} [Wed Sep 21 12:20:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 3661 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 21 12:20:59.978573 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-e61bce23-8087-472b-a1f5-cc289629f4bd tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.571851 Sep 21 12:20:59.986754 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 15/29] 10.222.0.71 () {60 vars in 1147 bytes} [Wed Sep 21 12:20:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 21 12:21:00.013442 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-30c0f8d0-f670-4587-90c7-1f7676e58d76 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:00.021831 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-30c0f8d0-f670-4587-90c7-1f7676e58d76 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:00.717700 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-30c0f8d0-f670-4587-90c7-1f7676e58d76 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:00.753107 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-30c0f8d0-f670-4587-90c7-1f7676e58d76 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:00.755671 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-30c0f8d0-f670-4587-90c7-1f7676e58d76 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:00.757208 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-30c0f8d0-f670-4587-90c7-1f7676e58d76 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1281 microversion: 2.20 time: 0.771979 Sep 21 12:21:00.761577 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 16/30] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:20:59 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1281 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:21:00.770763 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-8ca49ea5-2be8-49d3-93bc-c5a52dabfd38 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:00.775428 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-8ca49ea5-2be8-49d3-93bc-c5a52dabfd38 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:00.864271 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-8f89076a-b7ec-48f8-8984-dcb7edeb34bf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Action: 'create', calling method: .version_select at 0x7fe4c9ceec10>, body: {"keypair": {"name": "tempest-keypair-894034263", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjExEnG15X73BpppR36msC37suig/pzrqH/MV+n60jyzFYxVcYMBnZm9HKIf6FxWzkNUvbbANOoGC/OVRuaN2gflPrKr8c0GvZRET4Gw2HIaU97bTtZ3db6sAEal4dWQQ=="}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:21:00.900482 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-8ca49ea5-2be8-49d3-93bc-c5a52dabfd38 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:00.908560 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-8ca49ea5-2be8-49d3-93bc-c5a52dabfd38 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1215 microversion: 2.1 time: 0.142210 Sep 21 12:21:00.912893 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 17/31] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:00 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1215 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:00.944330 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.quota [None req-8f89076a-b7ec-48f8-8984-dcb7edeb34bf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Getting quotas for project 9340222cfe154efe8a6064b197d54499. Resources: {'key_pairs'} {{(pid=120463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 12:21:00.955618 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.quota [None req-8f89076a-b7ec-48f8-8984-dcb7edeb34bf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Getting quotas for user 8790c086dcaa4da5b739bcd02d30b4c0 and project 9340222cfe154efe8a6064b197d54499. Resources: {'key_pairs'} {{(pid=120463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 12:21:01.034869 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-8f89076a-b7ec-48f8-8984-dcb7edeb34bf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.060665 Sep 21 12:21:01.036188 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 15/32] 10.222.0.71 () {60 vars in 1159 bytes} [Wed Sep 21 12:20:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:21:01.792243 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-239b02ea-7674-4fad-a1d2-d999eefa4d0e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:01.793068 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-239b02ea-7674-4fad-a1d2-d999eefa4d0e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:01.941486 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-cb6a7203-46f3-49cf-adc8-7df9dcf50040 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:01.943082 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-cb6a7203-46f3-49cf-adc8-7df9dcf50040 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:02.006463 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-239b02ea-7674-4fad-a1d2-d999eefa4d0e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:02.032537 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-239b02ea-7674-4fad-a1d2-d999eefa4d0e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:02.047450 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-239b02ea-7674-4fad-a1d2-d999eefa4d0e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:02.056433 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-239b02ea-7674-4fad-a1d2-d999eefa4d0e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1281 microversion: 2.20 time: 0.269581 Sep 21 12:21:02.061774 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 18/33] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:01 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1281 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:21:02.340637 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-cb6a7203-46f3-49cf-adc8-7df9dcf50040 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:02.373989 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-cb6a7203-46f3-49cf-adc8-7df9dcf50040 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1215 microversion: 2.1 time: 0.439434 Sep 21 12:21:02.375509 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 16/34] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:01 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1215 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:03.091048 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-17543999-8a5c-4f56-9918-c8a858885a71 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:03.092604 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-17543999-8a5c-4f56-9918-c8a858885a71 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:03.106337 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-17543999-8a5c-4f56-9918-c8a858885a71 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:03.109949 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-17543999-8a5c-4f56-9918-c8a858885a71 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:03.110614 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-17543999-8a5c-4f56-9918-c8a858885a71 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:03.111638 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-17543999-8a5c-4f56-9918-c8a858885a71 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:03.113589 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-17543999-8a5c-4f56-9918-c8a858885a71 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:03.114221 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-17543999-8a5c-4f56-9918-c8a858885a71 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:03.401687 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-e2446a19-fcc5-48f8-8966-f299a32fb0cd tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:03.402309 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-e2446a19-fcc5-48f8-8966-f299a32fb0cd tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:03.476604 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-17543999-8a5c-4f56-9918-c8a858885a71 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:03.563601 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-17543999-8a5c-4f56-9918-c8a858885a71 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:03.575105 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-17543999-8a5c-4f56-9918-c8a858885a71 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:03.584232 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-17543999-8a5c-4f56-9918-c8a858885a71 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1285 microversion: 2.20 time: 0.493026 Sep 21 12:21:03.610535 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 19/35] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:03 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1285 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:21:03.673739 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-e2446a19-fcc5-48f8-8966-f299a32fb0cd tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:03.684425 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-e2446a19-fcc5-48f8-8966-f299a32fb0cd tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1215 microversion: 2.1 time: 0.283528 Sep 21 12:21:03.685126 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 17/36] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:03 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1215 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:04.615374 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-48b6c5db-f698-48b8-aa6d-e9e921c05ab9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:04.616872 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-48b6c5db-f698-48b8-aa6d-e9e921c05ab9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:04.627103 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-48b6c5db-f698-48b8-aa6d-e9e921c05ab9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:04.627895 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-48b6c5db-f698-48b8-aa6d-e9e921c05ab9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:04.628587 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-48b6c5db-f698-48b8-aa6d-e9e921c05ab9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:04.629560 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-48b6c5db-f698-48b8-aa6d-e9e921c05ab9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:04.630297 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-48b6c5db-f698-48b8-aa6d-e9e921c05ab9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:04.630864 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-48b6c5db-f698-48b8-aa6d-e9e921c05ab9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:04.715384 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-891276a7-9296-47c2-a292-1f393551f0ec tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:04.716138 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-891276a7-9296-47c2-a292-1f393551f0ec tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:04.727232 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-891276a7-9296-47c2-a292-1f393551f0ec tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:04.728855 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-891276a7-9296-47c2-a292-1f393551f0ec tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:04.731248 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-891276a7-9296-47c2-a292-1f393551f0ec tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:04.732221 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-891276a7-9296-47c2-a292-1f393551f0ec tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:04.734320 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-891276a7-9296-47c2-a292-1f393551f0ec tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:04.735259 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-891276a7-9296-47c2-a292-1f393551f0ec tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:04.778206 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-48b6c5db-f698-48b8-aa6d-e9e921c05ab9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:04.806458 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-48b6c5db-f698-48b8-aa6d-e9e921c05ab9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:04.808360 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-48b6c5db-f698-48b8-aa6d-e9e921c05ab9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:04.810347 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-48b6c5db-f698-48b8-aa6d-e9e921c05ab9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1277 microversion: 2.20 time: 0.199591 Sep 21 12:21:04.824215 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 20/37] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:04 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1277 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:21:04.967264 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-891276a7-9296-47c2-a292-1f393551f0ec tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:04.986073 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-891276a7-9296-47c2-a292-1f393551f0ec tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1219 microversion: 2.1 time: 0.275246 Sep 21 12:21:04.987371 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 18/38] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:04 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1219 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:21:05.016003 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-74411f2f-e00f-4729-bf5d-770029d3684c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1341164898", "imageRef": "1e3a8d95-6338-499c-af91-e3d1345af950", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5da5489c-9c30-4169-9afe-1354fb43296f"}], "security_groups": [{"name": "tempest-securitygroup--1734713918"}], "key_name": "tempest-keypair-894034263", "user_data": "}} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:21:05.188364 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.network.neutron [None req-74411f2f-e00f-4729-bf5d-770029d3684c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] validate_networks() for [('5da5489c-9c30-4169-9afe-1354fb43296f', None, None, None, None, None)] {{(pid=120462) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 12:21:05.664257 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-74411f2f-e00f-4729-bf5d-770029d3684c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Flavor limits 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 12:21:05.664829 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-74411f2f-e00f-4729-bf5d-770029d3684c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Image limits 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 12:21:05.665175 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-74411f2f-e00f-4729-bf5d-770029d3684c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Flavor pref 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 12:21:05.665587 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-74411f2f-e00f-4729-bf5d-770029d3684c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Image pref 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 12:21:05.666002 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-74411f2f-e00f-4729-bf5d-770029d3684c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 12:21:05.676976 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-74411f2f-e00f-4729-bf5d-770029d3684c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:05.677693 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-74411f2f-e00f-4729-bf5d-770029d3684c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:05.678170 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-74411f2f-e00f-4729-bf5d-770029d3684c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:05.678906 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-74411f2f-e00f-4729-bf5d-770029d3684c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:05.679363 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-74411f2f-e00f-4729-bf5d-770029d3684c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:05.679931 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-74411f2f-e00f-4729-bf5d-770029d3684c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:05.704041 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-74411f2f-e00f-4729-bf5d-770029d3684c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Getting quotas for project 9340222cfe154efe8a6064b197d54499. Resources: {'instances', 'ram', 'cores'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 12:21:05.708758 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-74411f2f-e00f-4729-bf5d-770029d3684c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Getting quotas for user 8790c086dcaa4da5b739bcd02d30b4c0 and project 9340222cfe154efe8a6064b197d54499. Resources: {'instances', 'ram', 'cores'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 12:21:05.721507 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-74411f2f-e00f-4729-bf5d-770029d3684c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Going to run 1 instances... {{(pid=120462) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 12:21:05.723910 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-74411f2f-e00f-4729-bf5d-770029d3684c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e3a8d95-6338-499c-af91-e3d1345af950',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 12:21:05.781000 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-74411f2f-e00f-4729-bf5d-770029d3684c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.770603 Sep 21 12:21:05.788027 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 21/39] 10.222.0.71 () {60 vars in 1147 bytes} [Wed Sep 21 12:21:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 21 12:21:05.795230 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-65c46824-e308-4f48-8fb4-dafffe277193 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:05.795893 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-65c46824-e308-4f48-8fb4-dafffe277193 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:05.854677 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-ae0d1dc3-25d4-425e-a0ea-bd1895f71c7d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:05.857504 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-ae0d1dc3-25d4-425e-a0ea-bd1895f71c7d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:05.867727 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ae0d1dc3-25d4-425e-a0ea-bd1895f71c7d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:05.868444 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ae0d1dc3-25d4-425e-a0ea-bd1895f71c7d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:05.868593 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-65c46824-e308-4f48-8fb4-dafffe277193 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:05.868898 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ae0d1dc3-25d4-425e-a0ea-bd1895f71c7d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:05.869663 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ae0d1dc3-25d4-425e-a0ea-bd1895f71c7d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:05.870127 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ae0d1dc3-25d4-425e-a0ea-bd1895f71c7d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:05.870567 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ae0d1dc3-25d4-425e-a0ea-bd1895f71c7d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:05.884495 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-65c46824-e308-4f48-8fb4-dafffe277193 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1237 microversion: 2.1 time: 0.095283 Sep 21 12:21:05.887084 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 19/40] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:05 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1237 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:06.011063 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-d194c1b1-b7c8-457f-a9a5-0659e58326c8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:06.011869 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-d194c1b1-b7c8-457f-a9a5-0659e58326c8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:06.016686 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-ae0d1dc3-25d4-425e-a0ea-bd1895f71c7d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:06.021487 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d194c1b1-b7c8-457f-a9a5-0659e58326c8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:06.024664 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d194c1b1-b7c8-457f-a9a5-0659e58326c8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:06.025140 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d194c1b1-b7c8-457f-a9a5-0659e58326c8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:06.025878 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d194c1b1-b7c8-457f-a9a5-0659e58326c8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:06.026351 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d194c1b1-b7c8-457f-a9a5-0659e58326c8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:06.026786 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d194c1b1-b7c8-457f-a9a5-0659e58326c8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:06.027242 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-ae0d1dc3-25d4-425e-a0ea-bd1895f71c7d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:06.030053 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-ae0d1dc3-25d4-425e-a0ea-bd1895f71c7d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:06.032032 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-ae0d1dc3-25d4-425e-a0ea-bd1895f71c7d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1277 microversion: 2.20 time: 0.181195 Sep 21 12:21:06.044271 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 22/41] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:05 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1277 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:21:06.180453 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-d194c1b1-b7c8-457f-a9a5-0659e58326c8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:06.190690 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-d194c1b1-b7c8-457f-a9a5-0659e58326c8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1219 microversion: 2.1 time: 0.183474 Sep 21 12:21:06.196369 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 20/42] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:06 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1219 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:06.910824 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-9859750e-64d4-468a-9a0c-43dc41d44a3b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:06.911544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-9859750e-64d4-468a-9a0c-43dc41d44a3b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:06.917790 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9859750e-64d4-468a-9a0c-43dc41d44a3b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:06.918283 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9859750e-64d4-468a-9a0c-43dc41d44a3b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:06.918785 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9859750e-64d4-468a-9a0c-43dc41d44a3b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:06.919912 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9859750e-64d4-468a-9a0c-43dc41d44a3b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:06.920407 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9859750e-64d4-468a-9a0c-43dc41d44a3b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:06.920842 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9859750e-64d4-468a-9a0c-43dc41d44a3b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:06.984793 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-9859750e-64d4-468a-9a0c-43dc41d44a3b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:06.994239 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-9859750e-64d4-468a-9a0c-43dc41d44a3b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1241 microversion: 2.1 time: 0.088400 Sep 21 12:21:06.994814 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 23/43] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:06 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:07.058165 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-0a9c0b36-e6a6-429c-81bd-b903a169b76b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:07.058783 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-0a9c0b36-e6a6-429c-81bd-b903a169b76b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:07.065949 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0a9c0b36-e6a6-429c-81bd-b903a169b76b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:07.066474 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0a9c0b36-e6a6-429c-81bd-b903a169b76b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:07.066921 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0a9c0b36-e6a6-429c-81bd-b903a169b76b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:07.067621 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0a9c0b36-e6a6-429c-81bd-b903a169b76b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:07.068107 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0a9c0b36-e6a6-429c-81bd-b903a169b76b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:07.068540 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0a9c0b36-e6a6-429c-81bd-b903a169b76b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:07.131463 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-0a9c0b36-e6a6-429c-81bd-b903a169b76b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:07.140463 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-0a9c0b36-e6a6-429c-81bd-b903a169b76b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:07.142330 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-0a9c0b36-e6a6-429c-81bd-b903a169b76b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:07.143790 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-0a9c0b36-e6a6-429c-81bd-b903a169b76b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1277 microversion: 2.20 time: 0.089575 Sep 21 12:21:07.144528 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 21/44] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:07 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1277 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:21:07.215792 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-2dec045f-a5df-438f-9cba-e13d417063c5 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:07.217270 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-2dec045f-a5df-438f-9cba-e13d417063c5 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:07.223519 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2dec045f-a5df-438f-9cba-e13d417063c5 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:07.224221 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2dec045f-a5df-438f-9cba-e13d417063c5 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:07.224603 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2dec045f-a5df-438f-9cba-e13d417063c5 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:07.225307 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2dec045f-a5df-438f-9cba-e13d417063c5 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:07.225767 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2dec045f-a5df-438f-9cba-e13d417063c5 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:07.226425 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2dec045f-a5df-438f-9cba-e13d417063c5 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:07.290914 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-2dec045f-a5df-438f-9cba-e13d417063c5 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:07.300144 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-2dec045f-a5df-438f-9cba-e13d417063c5 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1219 microversion: 2.1 time: 0.088451 Sep 21 12:21:07.300948 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 24/45] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:07 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:08.018193 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-ea134b65-dfc5-4ced-b40d-0f1408f11068 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:08.018885 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-ea134b65-dfc5-4ced-b40d-0f1408f11068 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:08.025176 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ea134b65-dfc5-4ced-b40d-0f1408f11068 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:08.025665 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ea134b65-dfc5-4ced-b40d-0f1408f11068 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:08.026129 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ea134b65-dfc5-4ced-b40d-0f1408f11068 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:08.026831 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ea134b65-dfc5-4ced-b40d-0f1408f11068 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:08.027283 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ea134b65-dfc5-4ced-b40d-0f1408f11068 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:08.027708 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ea134b65-dfc5-4ced-b40d-0f1408f11068 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:08.128387 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-ea134b65-dfc5-4ced-b40d-0f1408f11068 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:08.136388 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-ea134b65-dfc5-4ced-b40d-0f1408f11068 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1241 microversion: 2.1 time: 0.122630 Sep 21 12:21:08.136976 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 22/46] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:08 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1241 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:08.168899 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-3445ac69-6bce-441e-be41-cd0f93865b78 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:08.170842 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-3445ac69-6bce-441e-be41-cd0f93865b78 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:08.177733 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3445ac69-6bce-441e-be41-cd0f93865b78 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:08.178143 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3445ac69-6bce-441e-be41-cd0f93865b78 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:08.178922 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3445ac69-6bce-441e-be41-cd0f93865b78 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:08.179825 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3445ac69-6bce-441e-be41-cd0f93865b78 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:08.180598 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3445ac69-6bce-441e-be41-cd0f93865b78 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:08.180815 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3445ac69-6bce-441e-be41-cd0f93865b78 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:08.263672 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-3445ac69-6bce-441e-be41-cd0f93865b78 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:08.273963 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-3445ac69-6bce-441e-be41-cd0f93865b78 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:08.275493 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-3445ac69-6bce-441e-be41-cd0f93865b78 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:08.276767 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-3445ac69-6bce-441e-be41-cd0f93865b78 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1277 microversion: 2.20 time: 0.111948 Sep 21 12:21:08.280045 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 25/47] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:08 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1277 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:21:08.322547 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-963422b1-89b0-4394-8f9e-62bae5e4c320 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:08.323415 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-963422b1-89b0-4394-8f9e-62bae5e4c320 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:08.329361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-963422b1-89b0-4394-8f9e-62bae5e4c320 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:08.329938 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-963422b1-89b0-4394-8f9e-62bae5e4c320 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:08.330455 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-963422b1-89b0-4394-8f9e-62bae5e4c320 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:08.331230 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-963422b1-89b0-4394-8f9e-62bae5e4c320 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:08.331786 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-963422b1-89b0-4394-8f9e-62bae5e4c320 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:08.332305 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-963422b1-89b0-4394-8f9e-62bae5e4c320 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:08.403164 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-963422b1-89b0-4394-8f9e-62bae5e4c320 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:08.411119 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-963422b1-89b0-4394-8f9e-62bae5e4c320 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1219 microversion: 2.1 time: 0.092594 Sep 21 12:21:08.411709 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 23/48] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:08 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:09.160422 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-ae61aa6a-acd9-480d-bdea-ec9d790c0f54 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:09.161075 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-ae61aa6a-acd9-480d-bdea-ec9d790c0f54 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:09.166975 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ae61aa6a-acd9-480d-bdea-ec9d790c0f54 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:09.167468 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ae61aa6a-acd9-480d-bdea-ec9d790c0f54 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:09.167989 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ae61aa6a-acd9-480d-bdea-ec9d790c0f54 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:09.168688 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ae61aa6a-acd9-480d-bdea-ec9d790c0f54 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:09.169152 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ae61aa6a-acd9-480d-bdea-ec9d790c0f54 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:09.169710 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ae61aa6a-acd9-480d-bdea-ec9d790c0f54 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:09.232634 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-ae61aa6a-acd9-480d-bdea-ec9d790c0f54 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:09.239305 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-ae61aa6a-acd9-480d-bdea-ec9d790c0f54 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1241 microversion: 2.1 time: 0.082726 Sep 21 12:21:09.239911 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 26/49] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:09 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:09.303970 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-daf5bc64-d407-4442-a408-583660f59741 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:09.303970 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-daf5bc64-d407-4442-a408-583660f59741 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:09.318073 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-daf5bc64-d407-4442-a408-583660f59741 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:09.318654 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-daf5bc64-d407-4442-a408-583660f59741 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:09.319360 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-daf5bc64-d407-4442-a408-583660f59741 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:09.320282 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-daf5bc64-d407-4442-a408-583660f59741 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:09.320893 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-daf5bc64-d407-4442-a408-583660f59741 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:09.321716 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-daf5bc64-d407-4442-a408-583660f59741 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:09.397785 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-daf5bc64-d407-4442-a408-583660f59741 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:09.421071 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-daf5bc64-d407-4442-a408-583660f59741 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:09.423227 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-daf5bc64-d407-4442-a408-583660f59741 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:09.424749 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-daf5bc64-d407-4442-a408-583660f59741 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1277 microversion: 2.20 time: 0.126453 Sep 21 12:21:09.425876 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 24/50] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:09 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1277 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:21:09.442740 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-74db67d0-1d69-42b3-a3ac-f993bfb8ff2d tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:09.443427 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-74db67d0-1d69-42b3-a3ac-f993bfb8ff2d tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:09.452008 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-74db67d0-1d69-42b3-a3ac-f993bfb8ff2d tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:09.452641 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-74db67d0-1d69-42b3-a3ac-f993bfb8ff2d tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:09.453103 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-74db67d0-1d69-42b3-a3ac-f993bfb8ff2d tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:09.453840 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-74db67d0-1d69-42b3-a3ac-f993bfb8ff2d tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:09.454422 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-74db67d0-1d69-42b3-a3ac-f993bfb8ff2d tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:09.454916 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-74db67d0-1d69-42b3-a3ac-f993bfb8ff2d tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:09.534195 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-74db67d0-1d69-42b3-a3ac-f993bfb8ff2d tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:09.543107 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-74db67d0-1d69-42b3-a3ac-f993bfb8ff2d tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1219 microversion: 2.1 time: 0.104285 Sep 21 12:21:09.543706 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 27/51] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:09 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:10.266452 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-3cbd73a4-9bc9-49a6-ba27-735222cd89be tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:10.267303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-3cbd73a4-9bc9-49a6-ba27-735222cd89be tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:10.270665 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell0:SELECT=2 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:10.276709 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3cbd73a4-9bc9-49a6-ba27-735222cd89be tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:10.277197 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3cbd73a4-9bc9-49a6-ba27-735222cd89be tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:10.277809 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3cbd73a4-9bc9-49a6-ba27-735222cd89be tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:10.278538 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3cbd73a4-9bc9-49a6-ba27-735222cd89be tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:10.278993 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3cbd73a4-9bc9-49a6-ba27-735222cd89be tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:10.279415 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3cbd73a4-9bc9-49a6-ba27-735222cd89be tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:10.406982 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-3cbd73a4-9bc9-49a6-ba27-735222cd89be tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:10.430647 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-3cbd73a4-9bc9-49a6-ba27-735222cd89be tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1289 microversion: 2.1 time: 0.171122 Sep 21 12:21:10.431232 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 25/52] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:10 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1289 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:21:10.463876 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-d70375a2-bad2-4f8d-b0bd-224bcd09278a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:10.465226 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-d70375a2-bad2-4f8d-b0bd-224bcd09278a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:10.483338 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d70375a2-bad2-4f8d-b0bd-224bcd09278a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:10.484130 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d70375a2-bad2-4f8d-b0bd-224bcd09278a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:10.484745 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d70375a2-bad2-4f8d-b0bd-224bcd09278a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:10.485888 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d70375a2-bad2-4f8d-b0bd-224bcd09278a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:10.487251 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d70375a2-bad2-4f8d-b0bd-224bcd09278a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:10.488165 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d70375a2-bad2-4f8d-b0bd-224bcd09278a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:10.566364 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-ec1d0040-4eaf-430c-b830-26c9ce1bdceb tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:10.567157 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-ec1d0040-4eaf-430c-b830-26c9ce1bdceb tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:10.579869 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ec1d0040-4eaf-430c-b830-26c9ce1bdceb tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:10.580373 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ec1d0040-4eaf-430c-b830-26c9ce1bdceb tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:10.588511 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ec1d0040-4eaf-430c-b830-26c9ce1bdceb tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:10.589919 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ec1d0040-4eaf-430c-b830-26c9ce1bdceb tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:10.590652 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ec1d0040-4eaf-430c-b830-26c9ce1bdceb tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:10.591234 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ec1d0040-4eaf-430c-b830-26c9ce1bdceb tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:10.705015 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-ec1d0040-4eaf-430c-b830-26c9ce1bdceb tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:10.721350 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-ec1d0040-4eaf-430c-b830-26c9ce1bdceb tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1211 microversion: 2.1 time: 0.157444 Sep 21 12:21:10.722152 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 26/53] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:10 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1211 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:21:10.782010 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-d70375a2-bad2-4f8d-b0bd-224bcd09278a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:10.791348 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-d70375a2-bad2-4f8d-b0bd-224bcd09278a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:10.793440 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-d70375a2-bad2-4f8d-b0bd-224bcd09278a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:10.794646 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-d70375a2-bad2-4f8d-b0bd-224bcd09278a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1351 microversion: 2.20 time: 0.345861 Sep 21 12:21:10.795700 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 28/54] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:10 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1351 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:21:11.475380 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-7879176a-9924-4c1f-9d5d-e5af786b8718 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:11.476454 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-7879176a-9924-4c1f-9d5d-e5af786b8718 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:11.491918 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7879176a-9924-4c1f-9d5d-e5af786b8718 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:11.492426 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7879176a-9924-4c1f-9d5d-e5af786b8718 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:11.501371 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7879176a-9924-4c1f-9d5d-e5af786b8718 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:11.502160 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7879176a-9924-4c1f-9d5d-e5af786b8718 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:11.502664 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7879176a-9924-4c1f-9d5d-e5af786b8718 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:11.512248 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7879176a-9924-4c1f-9d5d-e5af786b8718 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:11.669103 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-7879176a-9924-4c1f-9d5d-e5af786b8718 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:11.680003 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-7879176a-9924-4c1f-9d5d-e5af786b8718 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1295 microversion: 2.1 time: 0.210108 Sep 21 12:21:11.692805 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 27/55] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:11 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1295 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:11.747980 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-758f8fb1-8658-4372-a1ca-0f91d1560afb tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:11.749497 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-758f8fb1-8658-4372-a1ca-0f91d1560afb tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:11.760143 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-758f8fb1-8658-4372-a1ca-0f91d1560afb tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:11.761006 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-758f8fb1-8658-4372-a1ca-0f91d1560afb tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:11.763127 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-758f8fb1-8658-4372-a1ca-0f91d1560afb tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:11.767403 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-758f8fb1-8658-4372-a1ca-0f91d1560afb tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:11.769289 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-758f8fb1-8658-4372-a1ca-0f91d1560afb tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:11.770201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-758f8fb1-8658-4372-a1ca-0f91d1560afb tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:11.820819 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-cf5ab4e0-f371-49da-b649-8dc464aed955 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:11.821754 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-cf5ab4e0-f371-49da-b649-8dc464aed955 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:11.833436 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cf5ab4e0-f371-49da-b649-8dc464aed955 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:11.837804 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cf5ab4e0-f371-49da-b649-8dc464aed955 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:11.838694 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cf5ab4e0-f371-49da-b649-8dc464aed955 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:11.841944 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cf5ab4e0-f371-49da-b649-8dc464aed955 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:11.844292 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cf5ab4e0-f371-49da-b649-8dc464aed955 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:11.845644 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cf5ab4e0-f371-49da-b649-8dc464aed955 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:11.939333 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-758f8fb1-8658-4372-a1ca-0f91d1560afb tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:11.951574 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-758f8fb1-8658-4372-a1ca-0f91d1560afb tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1267 microversion: 2.1 time: 0.208128 Sep 21 12:21:11.955067 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 29/56] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:11 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1267 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:21:12.047015 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-cf5ab4e0-f371-49da-b649-8dc464aed955 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:12.060115 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-cf5ab4e0-f371-49da-b649-8dc464aed955 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:12.062625 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-cf5ab4e0-f371-49da-b649-8dc464aed955 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:12.069706 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-cf5ab4e0-f371-49da-b649-8dc464aed955 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1339 microversion: 2.20 time: 0.252663 Sep 21 12:21:12.085098 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 28/57] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:11 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1339 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:21:12.709056 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-60625a11-772c-4971-b7ff-54f39e122563 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:12.710252 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-60625a11-772c-4971-b7ff-54f39e122563 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:12.726848 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-60625a11-772c-4971-b7ff-54f39e122563 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:12.727347 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-60625a11-772c-4971-b7ff-54f39e122563 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:12.727807 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-60625a11-772c-4971-b7ff-54f39e122563 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:12.728709 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-60625a11-772c-4971-b7ff-54f39e122563 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:12.729322 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-60625a11-772c-4971-b7ff-54f39e122563 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:12.729903 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-60625a11-772c-4971-b7ff-54f39e122563 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:12.978790 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-60625a11-772c-4971-b7ff-54f39e122563 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:12.985303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-21598e1d-2367-48f6-96c3-5112b29ff380 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:12.986563 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-21598e1d-2367-48f6-96c3-5112b29ff380 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:12.989674 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-60625a11-772c-4971-b7ff-54f39e122563 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1295 microversion: 2.1 time: 0.286717 Sep 21 12:21:12.990951 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 30/58] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:12 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1295 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:13.011913 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-21598e1d-2367-48f6-96c3-5112b29ff380 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:13.015201 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-21598e1d-2367-48f6-96c3-5112b29ff380 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:13.016272 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-21598e1d-2367-48f6-96c3-5112b29ff380 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:13.018637 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-21598e1d-2367-48f6-96c3-5112b29ff380 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:13.019228 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-21598e1d-2367-48f6-96c3-5112b29ff380 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:13.019960 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-21598e1d-2367-48f6-96c3-5112b29ff380 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:13.107708 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-193c9d2a-13e4-4473-bcb0-c19247dca61d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:13.108817 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-193c9d2a-13e4-4473-bcb0-c19247dca61d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:13.117244 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-193c9d2a-13e4-4473-bcb0-c19247dca61d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:13.118068 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-193c9d2a-13e4-4473-bcb0-c19247dca61d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:13.118751 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-193c9d2a-13e4-4473-bcb0-c19247dca61d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:13.120343 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-193c9d2a-13e4-4473-bcb0-c19247dca61d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:13.121303 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-193c9d2a-13e4-4473-bcb0-c19247dca61d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:13.121920 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-193c9d2a-13e4-4473-bcb0-c19247dca61d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:13.178942 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-21598e1d-2367-48f6-96c3-5112b29ff380 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:13.188681 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-21598e1d-2367-48f6-96c3-5112b29ff380 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1273 microversion: 2.1 time: 0.212035 Sep 21 12:21:13.200121 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 29/59] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:12 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1273 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:21:13.381982 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-193c9d2a-13e4-4473-bcb0-c19247dca61d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:13.395279 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-193c9d2a-13e4-4473-bcb0-c19247dca61d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:13.396770 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-193c9d2a-13e4-4473-bcb0-c19247dca61d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:13.397941 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-193c9d2a-13e4-4473-bcb0-c19247dca61d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.300807 Sep 21 12:21:13.400205 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 31/60] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:13 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:21:14.021547 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-52a5d38a-d54c-44c0-a37e-9799fa4a8366 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:14.022366 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-52a5d38a-d54c-44c0-a37e-9799fa4a8366 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:14.028702 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-52a5d38a-d54c-44c0-a37e-9799fa4a8366 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:14.029195 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-52a5d38a-d54c-44c0-a37e-9799fa4a8366 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:14.029658 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-52a5d38a-d54c-44c0-a37e-9799fa4a8366 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:14.030774 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-52a5d38a-d54c-44c0-a37e-9799fa4a8366 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:14.031125 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-52a5d38a-d54c-44c0-a37e-9799fa4a8366 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:14.031554 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-52a5d38a-d54c-44c0-a37e-9799fa4a8366 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:14.188770 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-52a5d38a-d54c-44c0-a37e-9799fa4a8366 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:14.196536 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-52a5d38a-d54c-44c0-a37e-9799fa4a8366 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.178805 Sep 21 12:21:14.197184 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 30/61] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:14 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:14.215816 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-4ef01c9e-2967-4725-a3f8-074bcf870ee4 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:14.215816 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-4ef01c9e-2967-4725-a3f8-074bcf870ee4 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:14.221514 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4ef01c9e-2967-4725-a3f8-074bcf870ee4 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:14.221948 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4ef01c9e-2967-4725-a3f8-074bcf870ee4 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:14.222382 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4ef01c9e-2967-4725-a3f8-074bcf870ee4 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:14.223098 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4ef01c9e-2967-4725-a3f8-074bcf870ee4 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:14.223548 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4ef01c9e-2967-4725-a3f8-074bcf870ee4 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:14.224004 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4ef01c9e-2967-4725-a3f8-074bcf870ee4 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:14.288383 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-4ef01c9e-2967-4725-a3f8-074bcf870ee4 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:14.296047 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-4ef01c9e-2967-4725-a3f8-074bcf870ee4 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1273 microversion: 2.1 time: 0.086097 Sep 21 12:21:14.307935 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 32/62] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:14 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1273 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:14.427650 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-baf041e0-33f8-4eca-b62c-58e79fb41c29 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:14.428398 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-baf041e0-33f8-4eca-b62c-58e79fb41c29 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:14.434390 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-baf041e0-33f8-4eca-b62c-58e79fb41c29 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:14.434874 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-baf041e0-33f8-4eca-b62c-58e79fb41c29 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:14.435314 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-baf041e0-33f8-4eca-b62c-58e79fb41c29 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:14.436591 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-baf041e0-33f8-4eca-b62c-58e79fb41c29 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:14.436986 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-baf041e0-33f8-4eca-b62c-58e79fb41c29 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:14.437413 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-baf041e0-33f8-4eca-b62c-58e79fb41c29 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:14.583126 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-baf041e0-33f8-4eca-b62c-58e79fb41c29 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:14.592613 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-baf041e0-33f8-4eca-b62c-58e79fb41c29 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:14.594372 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-baf041e0-33f8-4eca-b62c-58e79fb41c29 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:14.595506 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-baf041e0-33f8-4eca-b62c-58e79fb41c29 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.171868 Sep 21 12:21:14.596766 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 31/63] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:14 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:21:15.220607 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-25040f7b-3764-475b-8010-241e84384345 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:15.221225 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-25040f7b-3764-475b-8010-241e84384345 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:15.226965 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-25040f7b-3764-475b-8010-241e84384345 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:15.227450 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-25040f7b-3764-475b-8010-241e84384345 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:15.227992 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-25040f7b-3764-475b-8010-241e84384345 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:15.228689 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-25040f7b-3764-475b-8010-241e84384345 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:15.229145 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-25040f7b-3764-475b-8010-241e84384345 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:15.229569 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-25040f7b-3764-475b-8010-241e84384345 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:15.318657 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-42231fa0-955c-41da-84a1-4d80054013ae tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:15.319360 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-42231fa0-955c-41da-84a1-4d80054013ae tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:15.325371 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-42231fa0-955c-41da-84a1-4d80054013ae tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:15.325972 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-42231fa0-955c-41da-84a1-4d80054013ae tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:15.326487 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-42231fa0-955c-41da-84a1-4d80054013ae tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:15.327879 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-42231fa0-955c-41da-84a1-4d80054013ae tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:15.328411 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-42231fa0-955c-41da-84a1-4d80054013ae tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:15.329070 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-42231fa0-955c-41da-84a1-4d80054013ae tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:15.373248 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-25040f7b-3764-475b-8010-241e84384345 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:15.383252 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-25040f7b-3764-475b-8010-241e84384345 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.166409 Sep 21 12:21:15.383733 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 33/64] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:15 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:15.396330 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-42231fa0-955c-41da-84a1-4d80054013ae tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:15.406766 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-42231fa0-955c-41da-84a1-4d80054013ae tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1273 microversion: 2.1 time: 0.092143 Sep 21 12:21:15.407457 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 32/65] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:15 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1273 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:21:15.620276 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-7418b51f-b000-4bc3-8519-2b8d07757bd6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:15.620928 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-7418b51f-b000-4bc3-8519-2b8d07757bd6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:15.628454 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7418b51f-b000-4bc3-8519-2b8d07757bd6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:15.629140 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7418b51f-b000-4bc3-8519-2b8d07757bd6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:15.629819 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7418b51f-b000-4bc3-8519-2b8d07757bd6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:15.630512 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7418b51f-b000-4bc3-8519-2b8d07757bd6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:15.631147 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7418b51f-b000-4bc3-8519-2b8d07757bd6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:15.631659 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7418b51f-b000-4bc3-8519-2b8d07757bd6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:15.692869 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell0:SELECT=4 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:15.716652 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell0:SELECT=22 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:15.830488 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-7418b51f-b000-4bc3-8519-2b8d07757bd6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:15.839904 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-7418b51f-b000-4bc3-8519-2b8d07757bd6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:15.841317 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-7418b51f-b000-4bc3-8519-2b8d07757bd6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:15.842461 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-7418b51f-b000-4bc3-8519-2b8d07757bd6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.226232 Sep 21 12:21:15.843009 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 34/66] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:15 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:21:16.408687 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-b6238907-3652-416f-87ed-10467ea3fc90 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:16.409533 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-b6238907-3652-416f-87ed-10467ea3fc90 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:16.412922 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell0:SELECT=16 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:16.419612 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b6238907-3652-416f-87ed-10467ea3fc90 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:16.420897 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b6238907-3652-416f-87ed-10467ea3fc90 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:16.422566 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b6238907-3652-416f-87ed-10467ea3fc90 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:16.423491 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b6238907-3652-416f-87ed-10467ea3fc90 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:16.424439 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b6238907-3652-416f-87ed-10467ea3fc90 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:16.425060 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b6238907-3652-416f-87ed-10467ea3fc90 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:16.430551 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-c08d8465-1cad-45cc-af09-e75ad8158dc3 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:16.431747 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-c08d8465-1cad-45cc-af09-e75ad8158dc3 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:16.439169 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c08d8465-1cad-45cc-af09-e75ad8158dc3 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:16.443000 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c08d8465-1cad-45cc-af09-e75ad8158dc3 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:16.443638 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c08d8465-1cad-45cc-af09-e75ad8158dc3 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:16.444407 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c08d8465-1cad-45cc-af09-e75ad8158dc3 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:16.445045 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c08d8465-1cad-45cc-af09-e75ad8158dc3 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:16.445832 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c08d8465-1cad-45cc-af09-e75ad8158dc3 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:16.533985 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-c08d8465-1cad-45cc-af09-e75ad8158dc3 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:16.537976 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=100 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:16.553728 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-c08d8465-1cad-45cc-af09-e75ad8158dc3 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1273 microversion: 2.1 time: 0.127977 Sep 21 12:21:16.555275 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 35/67] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:16 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1273 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:21:16.626196 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-b6238907-3652-416f-87ed-10467ea3fc90 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:16.635279 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-b6238907-3652-416f-87ed-10467ea3fc90 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.232091 Sep 21 12:21:16.636136 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 33/68] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:16 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:16.867065 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-65b0a7e6-a58b-4b79-b289-c55ba024ca43 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:16.867679 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-65b0a7e6-a58b-4b79-b289-c55ba024ca43 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:16.873993 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-65b0a7e6-a58b-4b79-b289-c55ba024ca43 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:16.874488 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-65b0a7e6-a58b-4b79-b289-c55ba024ca43 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:16.874930 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-65b0a7e6-a58b-4b79-b289-c55ba024ca43 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:16.875696 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-65b0a7e6-a58b-4b79-b289-c55ba024ca43 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:16.876547 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-65b0a7e6-a58b-4b79-b289-c55ba024ca43 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:16.876997 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-65b0a7e6-a58b-4b79-b289-c55ba024ca43 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:17.051878 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-65b0a7e6-a58b-4b79-b289-c55ba024ca43 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:17.064088 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-65b0a7e6-a58b-4b79-b289-c55ba024ca43 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:17.066229 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-65b0a7e6-a58b-4b79-b289-c55ba024ca43 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:17.067487 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-65b0a7e6-a58b-4b79-b289-c55ba024ca43 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.204391 Sep 21 12:21:17.068842 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 36/69] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:16 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:21:17.580506 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-cc31251e-9670-4f7e-9d21-4e139f0f35cb tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:17.581548 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-cc31251e-9670-4f7e-9d21-4e139f0f35cb tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:17.588938 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cc31251e-9670-4f7e-9d21-4e139f0f35cb tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:17.589965 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cc31251e-9670-4f7e-9d21-4e139f0f35cb tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:17.590688 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cc31251e-9670-4f7e-9d21-4e139f0f35cb tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:17.592679 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cc31251e-9670-4f7e-9d21-4e139f0f35cb tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:17.611737 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cc31251e-9670-4f7e-9d21-4e139f0f35cb tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:17.612952 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cc31251e-9670-4f7e-9d21-4e139f0f35cb tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:17.666106 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-2c7efa36-a2ea-4e58-a656-821cffa7ccac tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:17.666934 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-2c7efa36-a2ea-4e58-a656-821cffa7ccac tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:17.682577 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2c7efa36-a2ea-4e58-a656-821cffa7ccac tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:17.683219 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2c7efa36-a2ea-4e58-a656-821cffa7ccac tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:17.683511 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2c7efa36-a2ea-4e58-a656-821cffa7ccac tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:17.687418 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2c7efa36-a2ea-4e58-a656-821cffa7ccac tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:17.688002 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2c7efa36-a2ea-4e58-a656-821cffa7ccac tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:17.692455 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2c7efa36-a2ea-4e58-a656-821cffa7ccac tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:17.726331 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-cc31251e-9670-4f7e-9d21-4e139f0f35cb tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:17.775348 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-cc31251e-9670-4f7e-9d21-4e139f0f35cb tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1273 microversion: 2.1 time: 0.197625 Sep 21 12:21:17.778286 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 34/70] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:17 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1273 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:17.994799 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-2c7efa36-a2ea-4e58-a656-821cffa7ccac tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:18.012709 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-2c7efa36-a2ea-4e58-a656-821cffa7ccac tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.357892 Sep 21 12:21:18.013342 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 37/71] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:17 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:21:18.096752 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-34d86e06-1e13-44ea-9815-e28fe027eb56 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:18.097884 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-34d86e06-1e13-44ea-9815-e28fe027eb56 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:18.110858 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-34d86e06-1e13-44ea-9815-e28fe027eb56 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:18.115520 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-34d86e06-1e13-44ea-9815-e28fe027eb56 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:18.116567 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-34d86e06-1e13-44ea-9815-e28fe027eb56 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:18.117814 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-34d86e06-1e13-44ea-9815-e28fe027eb56 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:18.118297 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-34d86e06-1e13-44ea-9815-e28fe027eb56 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:18.121117 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-34d86e06-1e13-44ea-9815-e28fe027eb56 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:18.133089 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=100 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:18.403654 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-34d86e06-1e13-44ea-9815-e28fe027eb56 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:18.443387 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-34d86e06-1e13-44ea-9815-e28fe027eb56 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:18.449603 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-34d86e06-1e13-44ea-9815-e28fe027eb56 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:18.452377 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-34d86e06-1e13-44ea-9815-e28fe027eb56 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.360296 Sep 21 12:21:18.453517 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 35/72] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:18 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:21:18.806324 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-da93ea45-cf02-4ab7-a8ef-db4aedbd8319 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:18.809132 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-da93ea45-cf02-4ab7-a8ef-db4aedbd8319 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:18.819414 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-da93ea45-cf02-4ab7-a8ef-db4aedbd8319 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:18.820090 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-da93ea45-cf02-4ab7-a8ef-db4aedbd8319 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:18.820603 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-da93ea45-cf02-4ab7-a8ef-db4aedbd8319 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:18.821987 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-da93ea45-cf02-4ab7-a8ef-db4aedbd8319 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:18.822670 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-da93ea45-cf02-4ab7-a8ef-db4aedbd8319 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:18.823503 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-da93ea45-cf02-4ab7-a8ef-db4aedbd8319 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:18.941167 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-da93ea45-cf02-4ab7-a8ef-db4aedbd8319 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:18.954197 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-da93ea45-cf02-4ab7-a8ef-db4aedbd8319 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1273 microversion: 2.1 time: 0.151835 Sep 21 12:21:18.955136 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 38/73] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:18 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1273 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:21:19.037204 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-6d807f2d-8e62-40f1-b2c6-f5df1267dab4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:19.037919 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-6d807f2d-8e62-40f1-b2c6-f5df1267dab4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:19.053653 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6d807f2d-8e62-40f1-b2c6-f5df1267dab4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:19.054181 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6d807f2d-8e62-40f1-b2c6-f5df1267dab4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:19.054624 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6d807f2d-8e62-40f1-b2c6-f5df1267dab4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:19.055338 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6d807f2d-8e62-40f1-b2c6-f5df1267dab4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:19.055823 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6d807f2d-8e62-40f1-b2c6-f5df1267dab4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:19.056364 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6d807f2d-8e62-40f1-b2c6-f5df1267dab4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:19.491720 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-402978bf-b620-4ab1-b2ca-89096723ba50 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:19.492716 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-402978bf-b620-4ab1-b2ca-89096723ba50 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:19.505512 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-402978bf-b620-4ab1-b2ca-89096723ba50 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:19.507312 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-402978bf-b620-4ab1-b2ca-89096723ba50 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:19.508052 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-402978bf-b620-4ab1-b2ca-89096723ba50 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:19.510594 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-402978bf-b620-4ab1-b2ca-89096723ba50 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:19.514698 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-402978bf-b620-4ab1-b2ca-89096723ba50 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:19.515383 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-402978bf-b620-4ab1-b2ca-89096723ba50 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:19.532952 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-6d807f2d-8e62-40f1-b2c6-f5df1267dab4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:19.549987 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-6d807f2d-8e62-40f1-b2c6-f5df1267dab4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.513300 Sep 21 12:21:19.552320 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 36/74] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:19 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:19.782477 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-402978bf-b620-4ab1-b2ca-89096723ba50 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:19.791675 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-402978bf-b620-4ab1-b2ca-89096723ba50 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:19.794460 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-402978bf-b620-4ab1-b2ca-89096723ba50 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:19.797380 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-402978bf-b620-4ab1-b2ca-89096723ba50 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.310724 Sep 21 12:21:19.798017 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 39/75] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:19 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:21:19.978528 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-d93878c1-63c1-4ff5-aa20-fb1d14b48327 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:19.979151 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-d93878c1-63c1-4ff5-aa20-fb1d14b48327 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:19.985735 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=4 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:19.987525 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d93878c1-63c1-4ff5-aa20-fb1d14b48327 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:19.987919 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d93878c1-63c1-4ff5-aa20-fb1d14b48327 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:19.988396 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d93878c1-63c1-4ff5-aa20-fb1d14b48327 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:19.989053 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d93878c1-63c1-4ff5-aa20-fb1d14b48327 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:19.989501 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d93878c1-63c1-4ff5-aa20-fb1d14b48327 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:19.990208 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d93878c1-63c1-4ff5-aa20-fb1d14b48327 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:20.086126 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-d93878c1-63c1-4ff5-aa20-fb1d14b48327 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:20.101409 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-d93878c1-63c1-4ff5-aa20-fb1d14b48327 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1273 microversion: 2.1 time: 0.126417 Sep 21 12:21:20.102307 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 37/76] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:19 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1273 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:20.583392 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-fa638d8b-7db4-4fb3-a0e0-9014a9195708 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:20.585214 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-fa638d8b-7db4-4fb3-a0e0-9014a9195708 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:20.588864 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:20.596858 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fa638d8b-7db4-4fb3-a0e0-9014a9195708 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:20.598098 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fa638d8b-7db4-4fb3-a0e0-9014a9195708 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:20.598758 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fa638d8b-7db4-4fb3-a0e0-9014a9195708 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:20.600346 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fa638d8b-7db4-4fb3-a0e0-9014a9195708 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:20.601326 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fa638d8b-7db4-4fb3-a0e0-9014a9195708 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:20.602144 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fa638d8b-7db4-4fb3-a0e0-9014a9195708 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:20.823035 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-301b250c-b098-4ab6-934e-e04b85949541 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:20.823663 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-301b250c-b098-4ab6-934e-e04b85949541 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:20.834873 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-301b250c-b098-4ab6-934e-e04b85949541 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:20.835294 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-301b250c-b098-4ab6-934e-e04b85949541 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:20.836553 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-301b250c-b098-4ab6-934e-e04b85949541 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:20.837457 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-301b250c-b098-4ab6-934e-e04b85949541 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:20.838244 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-301b250c-b098-4ab6-934e-e04b85949541 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:20.838826 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-301b250c-b098-4ab6-934e-e04b85949541 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:20.849538 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-fa638d8b-7db4-4fb3-a0e0-9014a9195708 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:20.862762 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-fa638d8b-7db4-4fb3-a0e0-9014a9195708 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.284777 Sep 21 12:21:20.883552 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 40/77] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:20 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:21.023531 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-301b250c-b098-4ab6-934e-e04b85949541 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:21.035898 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-301b250c-b098-4ab6-934e-e04b85949541 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:21.056230 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-301b250c-b098-4ab6-934e-e04b85949541 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:21.068742 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-301b250c-b098-4ab6-934e-e04b85949541 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.239811 Sep 21 12:21:21.070154 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 38/78] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:20 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:21:21.130397 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-523d23fd-9a66-4633-a0b3-d7114018ad1a tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:21.131397 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-523d23fd-9a66-4633-a0b3-d7114018ad1a tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:21.139889 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-523d23fd-9a66-4633-a0b3-d7114018ad1a tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:21.140367 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-523d23fd-9a66-4633-a0b3-d7114018ad1a tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:21.142391 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-523d23fd-9a66-4633-a0b3-d7114018ad1a tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:21.148595 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-523d23fd-9a66-4633-a0b3-d7114018ad1a tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:21.150231 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-523d23fd-9a66-4633-a0b3-d7114018ad1a tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:21.151049 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-523d23fd-9a66-4633-a0b3-d7114018ad1a tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:21.253629 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-523d23fd-9a66-4633-a0b3-d7114018ad1a tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:21.284507 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-523d23fd-9a66-4633-a0b3-d7114018ad1a tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1273 microversion: 2.1 time: 0.148926 Sep 21 12:21:21.285174 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 41/79] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:21 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1273 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:21.886544 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-699e4d0b-66e1-49dc-84fa-04ca46ff3391 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:21.887999 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-699e4d0b-66e1-49dc-84fa-04ca46ff3391 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:21.900246 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-699e4d0b-66e1-49dc-84fa-04ca46ff3391 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:21.901503 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-699e4d0b-66e1-49dc-84fa-04ca46ff3391 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:21.902287 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-699e4d0b-66e1-49dc-84fa-04ca46ff3391 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:21.903016 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-699e4d0b-66e1-49dc-84fa-04ca46ff3391 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:21.903861 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-699e4d0b-66e1-49dc-84fa-04ca46ff3391 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:21.904527 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-699e4d0b-66e1-49dc-84fa-04ca46ff3391 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:22.100623 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-5fadc062-e7db-40b6-a4e2-1cf381d6b26e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:22.101193 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-5fadc062-e7db-40b6-a4e2-1cf381d6b26e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:22.108233 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5fadc062-e7db-40b6-a4e2-1cf381d6b26e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:22.113107 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5fadc062-e7db-40b6-a4e2-1cf381d6b26e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:22.114052 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5fadc062-e7db-40b6-a4e2-1cf381d6b26e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:22.115909 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5fadc062-e7db-40b6-a4e2-1cf381d6b26e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:22.116621 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5fadc062-e7db-40b6-a4e2-1cf381d6b26e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:22.117250 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5fadc062-e7db-40b6-a4e2-1cf381d6b26e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:22.152146 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-699e4d0b-66e1-49dc-84fa-04ca46ff3391 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:22.163390 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-699e4d0b-66e1-49dc-84fa-04ca46ff3391 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.280943 Sep 21 12:21:22.171032 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 39/80] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:21 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:22.308146 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-704daa61-cfbc-44ac-8020-6dd51136910d tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:22.308797 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-704daa61-cfbc-44ac-8020-6dd51136910d tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:22.319459 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-704daa61-cfbc-44ac-8020-6dd51136910d tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:22.320056 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-704daa61-cfbc-44ac-8020-6dd51136910d tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:22.320437 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-704daa61-cfbc-44ac-8020-6dd51136910d tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:22.321151 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-704daa61-cfbc-44ac-8020-6dd51136910d tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:22.321614 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-704daa61-cfbc-44ac-8020-6dd51136910d tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:22.322046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-704daa61-cfbc-44ac-8020-6dd51136910d tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:22.326147 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-5fadc062-e7db-40b6-a4e2-1cf381d6b26e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:22.344347 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-5fadc062-e7db-40b6-a4e2-1cf381d6b26e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:22.348968 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-5fadc062-e7db-40b6-a4e2-1cf381d6b26e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:22.351394 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-5fadc062-e7db-40b6-a4e2-1cf381d6b26e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.259326 Sep 21 12:21:22.370239 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 42/81] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:22 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:21:22.452933 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-704daa61-cfbc-44ac-8020-6dd51136910d tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:22.462299 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-704daa61-cfbc-44ac-8020-6dd51136910d tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1273 microversion: 2.1 time: 0.158015 Sep 21 12:21:22.463486 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 40/82] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:22 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1273 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:21:23.200083 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-6002bba7-9ce0-424c-a7e2-7216ada66115 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:23.203585 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-6002bba7-9ce0-424c-a7e2-7216ada66115 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:23.210840 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6002bba7-9ce0-424c-a7e2-7216ada66115 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:23.211726 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6002bba7-9ce0-424c-a7e2-7216ada66115 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:23.212142 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6002bba7-9ce0-424c-a7e2-7216ada66115 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:23.212885 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6002bba7-9ce0-424c-a7e2-7216ada66115 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:23.213397 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6002bba7-9ce0-424c-a7e2-7216ada66115 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:23.213779 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6002bba7-9ce0-424c-a7e2-7216ada66115 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:23.380630 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-10f33d75-e96d-4808-bd13-efb28b6f4daa tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:23.381471 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-10f33d75-e96d-4808-bd13-efb28b6f4daa tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:23.390064 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-10f33d75-e96d-4808-bd13-efb28b6f4daa tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:23.394015 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-10f33d75-e96d-4808-bd13-efb28b6f4daa tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:23.410157 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-10f33d75-e96d-4808-bd13-efb28b6f4daa tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:23.412058 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-10f33d75-e96d-4808-bd13-efb28b6f4daa tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:23.412858 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-10f33d75-e96d-4808-bd13-efb28b6f4daa tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:23.413589 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-10f33d75-e96d-4808-bd13-efb28b6f4daa tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:23.565048 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-6002bba7-9ce0-424c-a7e2-7216ada66115 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:23.573765 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-6002bba7-9ce0-424c-a7e2-7216ada66115 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.381106 Sep 21 12:21:23.591749 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 43/83] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:23 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:23.606822 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-24034cc4-95a7-4834-b1e0-bbe129617067 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:23.608022 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-24034cc4-95a7-4834-b1e0-bbe129617067 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:23.619665 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-24034cc4-95a7-4834-b1e0-bbe129617067 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:23.620274 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-24034cc4-95a7-4834-b1e0-bbe129617067 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:23.627553 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-24034cc4-95a7-4834-b1e0-bbe129617067 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:23.628632 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-24034cc4-95a7-4834-b1e0-bbe129617067 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:23.629327 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-24034cc4-95a7-4834-b1e0-bbe129617067 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:23.629947 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-24034cc4-95a7-4834-b1e0-bbe129617067 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:23.742451 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-24034cc4-95a7-4834-b1e0-bbe129617067 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:23.748749 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-10f33d75-e96d-4808-bd13-efb28b6f4daa tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:23.758331 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-24034cc4-95a7-4834-b1e0-bbe129617067 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1273 microversion: 2.1 time: 0.162741 Sep 21 12:21:23.768837 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 44/84] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:23 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1273 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:23.768940 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-10f33d75-e96d-4808-bd13-efb28b6f4daa tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:23.768940 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-10f33d75-e96d-4808-bd13-efb28b6f4daa tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:23.775788 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-10f33d75-e96d-4808-bd13-efb28b6f4daa tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.393361 Sep 21 12:21:23.782053 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 41/85] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:23 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:21:24.600474 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-40940a33-9bc4-4b4c-ad25-a8b30502ce5d tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:24.601194 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-40940a33-9bc4-4b4c-ad25-a8b30502ce5d tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:24.608868 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-40940a33-9bc4-4b4c-ad25-a8b30502ce5d tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:24.609358 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-40940a33-9bc4-4b4c-ad25-a8b30502ce5d tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:24.609800 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-40940a33-9bc4-4b4c-ad25-a8b30502ce5d tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:24.610493 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-40940a33-9bc4-4b4c-ad25-a8b30502ce5d tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:24.610952 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-40940a33-9bc4-4b4c-ad25-a8b30502ce5d tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:24.611382 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-40940a33-9bc4-4b4c-ad25-a8b30502ce5d tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:24.742588 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-40940a33-9bc4-4b4c-ad25-a8b30502ce5d tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:24.752098 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-40940a33-9bc4-4b4c-ad25-a8b30502ce5d tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.155301 Sep 21 12:21:24.752957 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 45/86] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:24 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:24.787581 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-06881e96-77cd-4bd6-8e63-d8b25d045876 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:24.788267 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-06881e96-77cd-4bd6-8e63-d8b25d045876 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:24.794393 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-06881e96-77cd-4bd6-8e63-d8b25d045876 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:24.794883 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-06881e96-77cd-4bd6-8e63-d8b25d045876 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:24.796722 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-06881e96-77cd-4bd6-8e63-d8b25d045876 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:24.796722 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-06881e96-77cd-4bd6-8e63-d8b25d045876 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:24.796722 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-06881e96-77cd-4bd6-8e63-d8b25d045876 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:24.797180 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-06881e96-77cd-4bd6-8e63-d8b25d045876 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:24.799062 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-b1878a5e-2804-4dc8-9652-5239b1449ebd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:24.799801 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-b1878a5e-2804-4dc8-9652-5239b1449ebd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:24.806327 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b1878a5e-2804-4dc8-9652-5239b1449ebd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:24.806810 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b1878a5e-2804-4dc8-9652-5239b1449ebd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:24.807254 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b1878a5e-2804-4dc8-9652-5239b1449ebd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:24.807975 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b1878a5e-2804-4dc8-9652-5239b1449ebd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:24.808432 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b1878a5e-2804-4dc8-9652-5239b1449ebd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:24.808856 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b1878a5e-2804-4dc8-9652-5239b1449ebd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:24.880255 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-06881e96-77cd-4bd6-8e63-d8b25d045876 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:24.891701 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-06881e96-77cd-4bd6-8e63-d8b25d045876 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1273 microversion: 2.1 time: 0.107618 Sep 21 12:21:24.892247 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 42/87] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:24 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1273 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:21:24.962099 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-b1878a5e-2804-4dc8-9652-5239b1449ebd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:24.970131 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-b1878a5e-2804-4dc8-9652-5239b1449ebd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:24.971595 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-b1878a5e-2804-4dc8-9652-5239b1449ebd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:24.972751 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-b1878a5e-2804-4dc8-9652-5239b1449ebd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.178347 Sep 21 12:21:24.973322 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 46/88] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:24 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:21:25.776281 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-3542c2c9-6116-4189-8f49-7bb1d802ec85 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:25.776902 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-3542c2c9-6116-4189-8f49-7bb1d802ec85 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:25.783481 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3542c2c9-6116-4189-8f49-7bb1d802ec85 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:25.784048 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3542c2c9-6116-4189-8f49-7bb1d802ec85 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:25.784492 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3542c2c9-6116-4189-8f49-7bb1d802ec85 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:25.785188 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3542c2c9-6116-4189-8f49-7bb1d802ec85 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:25.785646 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3542c2c9-6116-4189-8f49-7bb1d802ec85 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:25.786076 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3542c2c9-6116-4189-8f49-7bb1d802ec85 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:25.924513 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-d225b059-2cee-45ba-a495-c023811c130f tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:25.925945 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-d225b059-2cee-45ba-a495-c023811c130f tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:25.934469 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d225b059-2cee-45ba-a495-c023811c130f tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:25.934974 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d225b059-2cee-45ba-a495-c023811c130f tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:25.935417 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d225b059-2cee-45ba-a495-c023811c130f tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:25.936195 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d225b059-2cee-45ba-a495-c023811c130f tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:25.936816 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d225b059-2cee-45ba-a495-c023811c130f tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:25.937395 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d225b059-2cee-45ba-a495-c023811c130f tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:26.025933 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-3542c2c9-6116-4189-8f49-7bb1d802ec85 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:26.034519 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-3542c2c9-6116-4189-8f49-7bb1d802ec85 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.262365 Sep 21 12:21:26.039208 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 43/89] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:25 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:26.049238 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-bdb27aa7-ca6b-498b-b088-304b6aac1602 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:26.049965 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-bdb27aa7-ca6b-498b-b088-304b6aac1602 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:26.053680 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-d225b059-2cee-45ba-a495-c023811c130f tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:26.061541 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bdb27aa7-ca6b-498b-b088-304b6aac1602 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:26.064163 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bdb27aa7-ca6b-498b-b088-304b6aac1602 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:26.064695 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bdb27aa7-ca6b-498b-b088-304b6aac1602 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:26.065444 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bdb27aa7-ca6b-498b-b088-304b6aac1602 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:26.065977 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bdb27aa7-ca6b-498b-b088-304b6aac1602 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:26.066433 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bdb27aa7-ca6b-498b-b088-304b6aac1602 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:26.067951 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-d225b059-2cee-45ba-a495-c023811c130f tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1273 microversion: 2.1 time: 0.157567 Sep 21 12:21:26.069092 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 47/90] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:25 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1273 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:26.243250 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-bdb27aa7-ca6b-498b-b088-304b6aac1602 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:26.252442 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-bdb27aa7-ca6b-498b-b088-304b6aac1602 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:26.253920 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-bdb27aa7-ca6b-498b-b088-304b6aac1602 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:26.255036 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-bdb27aa7-ca6b-498b-b088-304b6aac1602 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.214829 Sep 21 12:21:26.255604 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 44/91] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:26 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:21:27.077153 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-a9576ee2-9635-46c0-92c1-fe3bbbe03b09 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:27.077934 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-a9576ee2-9635-46c0-92c1-fe3bbbe03b09 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:27.086974 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a9576ee2-9635-46c0-92c1-fe3bbbe03b09 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:27.087781 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a9576ee2-9635-46c0-92c1-fe3bbbe03b09 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:27.088509 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a9576ee2-9635-46c0-92c1-fe3bbbe03b09 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:27.089537 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a9576ee2-9635-46c0-92c1-fe3bbbe03b09 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:27.092853 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a9576ee2-9635-46c0-92c1-fe3bbbe03b09 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:27.093589 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a9576ee2-9635-46c0-92c1-fe3bbbe03b09 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:27.101371 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-f3098561-34c0-4d44-9efe-1f0675c7a12e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:27.102000 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-f3098561-34c0-4d44-9efe-1f0675c7a12e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:27.109837 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f3098561-34c0-4d44-9efe-1f0675c7a12e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:27.110329 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f3098561-34c0-4d44-9efe-1f0675c7a12e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:27.110761 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f3098561-34c0-4d44-9efe-1f0675c7a12e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:27.111671 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f3098561-34c0-4d44-9efe-1f0675c7a12e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:27.112754 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f3098561-34c0-4d44-9efe-1f0675c7a12e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:27.113374 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f3098561-34c0-4d44-9efe-1f0675c7a12e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:27.209081 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-f3098561-34c0-4d44-9efe-1f0675c7a12e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:27.217336 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-f3098561-34c0-4d44-9efe-1f0675c7a12e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1273 microversion: 2.1 time: 0.121542 Sep 21 12:21:27.217915 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 45/92] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:27 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1273 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:27.274529 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-a9576ee2-9635-46c0-92c1-fe3bbbe03b09 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:27.283877 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-90792eff-d1fd-460a-9b3f-b15bcfac5efd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:27.284493 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-90792eff-d1fd-460a-9b3f-b15bcfac5efd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:27.287990 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-a9576ee2-9635-46c0-92c1-fe3bbbe03b09 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.227094 Sep 21 12:21:27.289628 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 48/93] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:27 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:21:27.296272 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-90792eff-d1fd-460a-9b3f-b15bcfac5efd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:27.297061 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-90792eff-d1fd-460a-9b3f-b15bcfac5efd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:27.297890 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-90792eff-d1fd-460a-9b3f-b15bcfac5efd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:27.298904 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-90792eff-d1fd-460a-9b3f-b15bcfac5efd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:27.299356 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-90792eff-d1fd-460a-9b3f-b15bcfac5efd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:27.299810 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-90792eff-d1fd-460a-9b3f-b15bcfac5efd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:27.466109 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-90792eff-d1fd-460a-9b3f-b15bcfac5efd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:27.478564 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-90792eff-d1fd-460a-9b3f-b15bcfac5efd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:27.480629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-90792eff-d1fd-460a-9b3f-b15bcfac5efd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:27.483011 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-90792eff-d1fd-460a-9b3f-b15bcfac5efd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.203964 Sep 21 12:21:27.484205 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 46/94] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:27 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:21:28.240765 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-bb46ae2f-00bf-4b62-aae3-7be26e1cf292 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:28.241245 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-bb46ae2f-00bf-4b62-aae3-7be26e1cf292 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:28.249097 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bb46ae2f-00bf-4b62-aae3-7be26e1cf292 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:28.249698 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bb46ae2f-00bf-4b62-aae3-7be26e1cf292 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:28.250180 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bb46ae2f-00bf-4b62-aae3-7be26e1cf292 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:28.250958 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bb46ae2f-00bf-4b62-aae3-7be26e1cf292 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:28.251635 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bb46ae2f-00bf-4b62-aae3-7be26e1cf292 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:28.252311 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bb46ae2f-00bf-4b62-aae3-7be26e1cf292 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:28.312392 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-390ac7fc-55ee-4e46-8cd1-c5bbb0edc350 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:28.313841 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-390ac7fc-55ee-4e46-8cd1-c5bbb0edc350 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:28.317001 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-bb46ae2f-00bf-4b62-aae3-7be26e1cf292 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:28.321138 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-390ac7fc-55ee-4e46-8cd1-c5bbb0edc350 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:28.321698 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-390ac7fc-55ee-4e46-8cd1-c5bbb0edc350 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:28.322209 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-390ac7fc-55ee-4e46-8cd1-c5bbb0edc350 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:28.323135 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-390ac7fc-55ee-4e46-8cd1-c5bbb0edc350 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:28.323666 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-390ac7fc-55ee-4e46-8cd1-c5bbb0edc350 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:28.324232 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-390ac7fc-55ee-4e46-8cd1-c5bbb0edc350 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:28.324512 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-bb46ae2f-00bf-4b62-aae3-7be26e1cf292 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1273 microversion: 2.1 time: 0.087759 Sep 21 12:21:28.325274 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 49/95] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:28 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1273 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:28.458960 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-390ac7fc-55ee-4e46-8cd1-c5bbb0edc350 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:28.468242 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-390ac7fc-55ee-4e46-8cd1-c5bbb0edc350 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.160195 Sep 21 12:21:28.472553 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 47/96] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:28 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:21:28.510212 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-102ac6c1-1498-41a9-ba73-885a82f0f5c5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:28.510825 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-102ac6c1-1498-41a9-ba73-885a82f0f5c5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:28.525138 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-102ac6c1-1498-41a9-ba73-885a82f0f5c5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:28.525635 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-102ac6c1-1498-41a9-ba73-885a82f0f5c5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:28.526067 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-102ac6c1-1498-41a9-ba73-885a82f0f5c5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:28.526759 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-102ac6c1-1498-41a9-ba73-885a82f0f5c5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:28.527213 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-102ac6c1-1498-41a9-ba73-885a82f0f5c5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:28.527840 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-102ac6c1-1498-41a9-ba73-885a82f0f5c5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:28.706552 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-102ac6c1-1498-41a9-ba73-885a82f0f5c5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:28.714912 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-102ac6c1-1498-41a9-ba73-885a82f0f5c5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:28.716393 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-102ac6c1-1498-41a9-ba73-885a82f0f5c5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:28.717495 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-102ac6c1-1498-41a9-ba73-885a82f0f5c5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.211139 Sep 21 12:21:28.718057 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 50/97] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:28 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:21:29.349437 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-d7deb7a4-c122-4e43-a82d-857035b93853 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:29.351075 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-d7deb7a4-c122-4e43-a82d-857035b93853 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:29.360292 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d7deb7a4-c122-4e43-a82d-857035b93853 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:29.360894 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d7deb7a4-c122-4e43-a82d-857035b93853 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:29.361403 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d7deb7a4-c122-4e43-a82d-857035b93853 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:29.362293 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d7deb7a4-c122-4e43-a82d-857035b93853 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:29.362814 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d7deb7a4-c122-4e43-a82d-857035b93853 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:29.363418 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d7deb7a4-c122-4e43-a82d-857035b93853 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:29.434707 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-d7deb7a4-c122-4e43-a82d-857035b93853 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:29.444221 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-d7deb7a4-c122-4e43-a82d-857035b93853 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1273 microversion: 2.1 time: 0.101004 Sep 21 12:21:29.445449 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 48/98] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:29 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1273 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:29.496166 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-f355cf8f-ce19-4900-94f8-07cb455ff3e7 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:29.497527 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-f355cf8f-ce19-4900-94f8-07cb455ff3e7 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:29.535334 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f355cf8f-ce19-4900-94f8-07cb455ff3e7 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:29.536990 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f355cf8f-ce19-4900-94f8-07cb455ff3e7 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:29.537466 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f355cf8f-ce19-4900-94f8-07cb455ff3e7 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:29.539376 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f355cf8f-ce19-4900-94f8-07cb455ff3e7 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:29.541530 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f355cf8f-ce19-4900-94f8-07cb455ff3e7 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:29.542962 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f355cf8f-ce19-4900-94f8-07cb455ff3e7 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:29.747205 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-3345dbea-fb20-4bc8-8dd6-6f866c7721d6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:29.749233 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-3345dbea-fb20-4bc8-8dd6-6f866c7721d6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:29.758042 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3345dbea-fb20-4bc8-8dd6-6f866c7721d6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:29.758555 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3345dbea-fb20-4bc8-8dd6-6f866c7721d6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:29.759002 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3345dbea-fb20-4bc8-8dd6-6f866c7721d6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:29.759715 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3345dbea-fb20-4bc8-8dd6-6f866c7721d6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:29.760365 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3345dbea-fb20-4bc8-8dd6-6f866c7721d6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:29.760802 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3345dbea-fb20-4bc8-8dd6-6f866c7721d6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:29.901872 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-f355cf8f-ce19-4900-94f8-07cb455ff3e7 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:29.916259 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-f355cf8f-ce19-4900-94f8-07cb455ff3e7 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.423744 Sep 21 12:21:29.927974 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 51/99] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:29 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:30.292033 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-3345dbea-fb20-4bc8-8dd6-6f866c7721d6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:30.316574 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-3345dbea-fb20-4bc8-8dd6-6f866c7721d6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:30.325008 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-3345dbea-fb20-4bc8-8dd6-6f866c7721d6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:30.326242 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-3345dbea-fb20-4bc8-8dd6-6f866c7721d6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.587335 Sep 21 12:21:30.326860 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 49/100] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:29 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:21:30.467011 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-f73ca939-b63c-4ceb-8bfd-a78682b37b56 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:30.467637 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-f73ca939-b63c-4ceb-8bfd-a78682b37b56 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:30.491257 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f73ca939-b63c-4ceb-8bfd-a78682b37b56 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:30.492093 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f73ca939-b63c-4ceb-8bfd-a78682b37b56 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:30.492601 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f73ca939-b63c-4ceb-8bfd-a78682b37b56 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:30.493514 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f73ca939-b63c-4ceb-8bfd-a78682b37b56 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:30.494157 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f73ca939-b63c-4ceb-8bfd-a78682b37b56 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:30.494754 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f73ca939-b63c-4ceb-8bfd-a78682b37b56 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:30.520297 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=100 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:30.953312 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-7408b438-85f9-455d-93cc-c40388a93b48 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:30.959866 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-7408b438-85f9-455d-93cc-c40388a93b48 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:30.979210 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7408b438-85f9-455d-93cc-c40388a93b48 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:30.981725 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7408b438-85f9-455d-93cc-c40388a93b48 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:30.982353 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7408b438-85f9-455d-93cc-c40388a93b48 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:30.983398 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7408b438-85f9-455d-93cc-c40388a93b48 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:30.984464 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7408b438-85f9-455d-93cc-c40388a93b48 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:30.985030 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7408b438-85f9-455d-93cc-c40388a93b48 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:31.053469 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-f73ca939-b63c-4ceb-8bfd-a78682b37b56 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:31.067779 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-f73ca939-b63c-4ceb-8bfd-a78682b37b56 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.605029 Sep 21 12:21:31.068586 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 52/101] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:30 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:31.222927 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-7408b438-85f9-455d-93cc-c40388a93b48 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:31.239570 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-7408b438-85f9-455d-93cc-c40388a93b48 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.294502 Sep 21 12:21:31.240272 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 50/102] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:30 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:31.244674 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-e01e3339-b78c-484a-a923-77ba2c8d585c req-c1b5f93d-4107-49d2-afa6-f0653ae0406a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e9ebd08-4c95-43f6-a1a4-3268532d961e", "tag": "1f39c2aa-a245-4b77-8233-20f0c6c6cb30"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:21:31.266781 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-e01e3339-b78c-484a-a923-77ba2c8d585c req-c1b5f93d-4107-49d2-afa6-f0653ae0406a service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:31.267969 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-e01e3339-b78c-484a-a923-77ba2c8d585c req-c1b5f93d-4107-49d2-afa6-f0653ae0406a service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:31.268877 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-e01e3339-b78c-484a-a923-77ba2c8d585c req-c1b5f93d-4107-49d2-afa6-f0653ae0406a service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:31.310719 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-e01e3339-b78c-484a-a923-77ba2c8d585c req-c1b5f93d-4107-49d2-afa6-f0653ae0406a service nova] Creating event network-changed:1f39c2aa-a245-4b77-8233-20f0c6c6cb30 for instance 5e9ebd08-4c95-43f6-a1a4-3268532d961e on hv-cinder-85867 Sep 21 12:21:31.311424 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-e01e3339-b78c-484a-a923-77ba2c8d585c req-c1b5f93d-4107-49d2-afa6-f0653ae0406a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120462) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 21 12:21:31.312055 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-e01e3339-b78c-484a-a923-77ba2c8d585c req-c1b5f93d-4107-49d2-afa6-f0653ae0406a service nova] Acquired lock "compute-rpcapi-router" {{(pid=120462) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 21 12:21:31.313676 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-743ff315-feb3-43aa-a4ac-392b9db81211 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:31.314207 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-743ff315-feb3-43aa-a4ac-392b9db81211 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:31.314691 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-743ff315-feb3-43aa-a4ac-392b9db81211 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:31.315572 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-743ff315-feb3-43aa-a4ac-392b9db81211 None None] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:31.316418 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-743ff315-feb3-43aa-a4ac-392b9db81211 None None] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:31.316790 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-743ff315-feb3-43aa-a4ac-392b9db81211 None None] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:31.325742 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.compute.rpcapi [None req-743ff315-feb3-43aa-a4ac-392b9db81211 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 21 12:21:31.327398 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-743ff315-feb3-43aa-a4ac-392b9db81211 None None] Releasing lock "compute-rpcapi-router" {{(pid=120462) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 21 12:21:31.346815 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-743ff315-feb3-43aa-a4ac-392b9db81211 None None] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.242893 Sep 21 12:21:31.347678 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 53/103] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 12:21:31.356846 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-aeefc220-0adb-4645-902f-81ee16359330 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:31.357572 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-aeefc220-0adb-4645-902f-81ee16359330 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:31.364960 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-aeefc220-0adb-4645-902f-81ee16359330 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:31.365653 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-aeefc220-0adb-4645-902f-81ee16359330 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:31.366768 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-aeefc220-0adb-4645-902f-81ee16359330 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:31.367613 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-aeefc220-0adb-4645-902f-81ee16359330 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:31.368570 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-aeefc220-0adb-4645-902f-81ee16359330 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:31.368988 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-aeefc220-0adb-4645-902f-81ee16359330 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:31.513527 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-aeefc220-0adb-4645-902f-81ee16359330 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:31.517052 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=100 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:31.523017 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-aeefc220-0adb-4645-902f-81ee16359330 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:31.524504 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-aeefc220-0adb-4645-902f-81ee16359330 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:31.525717 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-aeefc220-0adb-4645-902f-81ee16359330 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.176568 Sep 21 12:21:31.526312 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 51/104] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:31 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:21:31.984931 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-34bee600-7b8a-45a1-b34f-2aaf5746b7fd req-aae11630-03b2-4a06-9859-0d29fb6773f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee010d1f-46d4-487e-a93e-66c5e2ac895e", "tag": "ee7ca2d0-d70f-46f5-af82-81e48a262d02"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:21:31.995798 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-34bee600-7b8a-45a1-b34f-2aaf5746b7fd req-aae11630-03b2-4a06-9859-0d29fb6773f3 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:31.996291 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-34bee600-7b8a-45a1-b34f-2aaf5746b7fd req-aae11630-03b2-4a06-9859-0d29fb6773f3 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:31.996720 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-34bee600-7b8a-45a1-b34f-2aaf5746b7fd req-aae11630-03b2-4a06-9859-0d29fb6773f3 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:32.006794 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-34bee600-7b8a-45a1-b34f-2aaf5746b7fd req-aae11630-03b2-4a06-9859-0d29fb6773f3 service nova] Creating event network-changed:ee7ca2d0-d70f-46f5-af82-81e48a262d02 for instance ee010d1f-46d4-487e-a93e-66c5e2ac895e on hv-cinder-85867 Sep 21 12:21:32.011663 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-34bee600-7b8a-45a1-b34f-2aaf5746b7fd req-aae11630-03b2-4a06-9859-0d29fb6773f3 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091653 Sep 21 12:21:32.012297 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 54/105] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:21:32.093462 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-b8ce6ac0-0d7e-48ac-9b02-d4c7205933ea tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:32.094068 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-b8ce6ac0-0d7e-48ac-9b02-d4c7205933ea tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:32.100115 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b8ce6ac0-0d7e-48ac-9b02-d4c7205933ea tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:32.100522 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b8ce6ac0-0d7e-48ac-9b02-d4c7205933ea tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:32.100952 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b8ce6ac0-0d7e-48ac-9b02-d4c7205933ea tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:32.101649 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b8ce6ac0-0d7e-48ac-9b02-d4c7205933ea tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:32.102094 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b8ce6ac0-0d7e-48ac-9b02-d4c7205933ea tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:32.102510 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b8ce6ac0-0d7e-48ac-9b02-d4c7205933ea tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:32.233702 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-b8ce6ac0-0d7e-48ac-9b02-d4c7205933ea tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:32.241230 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-b8ce6ac0-0d7e-48ac-9b02-d4c7205933ea tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.152365 Sep 21 12:21:32.241791 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 52/106] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:32 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:32.262817 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-70197a37-901f-4a0e-8fa3-1cb6a399015a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:32.264052 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-70197a37-901f-4a0e-8fa3-1cb6a399015a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:32.270143 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-70197a37-901f-4a0e-8fa3-1cb6a399015a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:32.270630 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-70197a37-901f-4a0e-8fa3-1cb6a399015a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:32.271067 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-70197a37-901f-4a0e-8fa3-1cb6a399015a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:32.271802 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-70197a37-901f-4a0e-8fa3-1cb6a399015a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:32.272233 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-70197a37-901f-4a0e-8fa3-1cb6a399015a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:32.272661 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-70197a37-901f-4a0e-8fa3-1cb6a399015a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:32.406409 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-70197a37-901f-4a0e-8fa3-1cb6a399015a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:32.413984 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-70197a37-901f-4a0e-8fa3-1cb6a399015a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.155343 Sep 21 12:21:32.414553 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 55/107] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:32 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:32.550350 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-a10dd6a4-57e8-4801-9557-192e5bc362b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:32.550956 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-a10dd6a4-57e8-4801-9557-192e5bc362b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:32.557437 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a10dd6a4-57e8-4801-9557-192e5bc362b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:32.558170 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a10dd6a4-57e8-4801-9557-192e5bc362b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:32.558609 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a10dd6a4-57e8-4801-9557-192e5bc362b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:32.559305 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a10dd6a4-57e8-4801-9557-192e5bc362b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:32.559774 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a10dd6a4-57e8-4801-9557-192e5bc362b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:32.560692 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a10dd6a4-57e8-4801-9557-192e5bc362b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:32.688840 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a10dd6a4-57e8-4801-9557-192e5bc362b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:32.697094 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a10dd6a4-57e8-4801-9557-192e5bc362b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:32.698580 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a10dd6a4-57e8-4801-9557-192e5bc362b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:32.699687 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-a10dd6a4-57e8-4801-9557-192e5bc362b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.153213 Sep 21 12:21:32.700274 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 53/108] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:32 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:21:33.265009 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-9dad83f6-797d-464b-b73a-821a6119acd3 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:33.265951 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-9dad83f6-797d-464b-b73a-821a6119acd3 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:33.273170 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9dad83f6-797d-464b-b73a-821a6119acd3 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:33.273657 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9dad83f6-797d-464b-b73a-821a6119acd3 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:33.274108 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9dad83f6-797d-464b-b73a-821a6119acd3 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:33.274804 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9dad83f6-797d-464b-b73a-821a6119acd3 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:33.275221 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9dad83f6-797d-464b-b73a-821a6119acd3 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:33.275639 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9dad83f6-797d-464b-b73a-821a6119acd3 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:33.411548 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-9dad83f6-797d-464b-b73a-821a6119acd3 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:33.419500 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-9dad83f6-797d-464b-b73a-821a6119acd3 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.159493 Sep 21 12:21:33.420709 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 56/109] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:33 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:33.436410 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-0a63096b-a117-4a40-b224-d4dc5b2a9060 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:33.437022 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-0a63096b-a117-4a40-b224-d4dc5b2a9060 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:33.442913 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0a63096b-a117-4a40-b224-d4dc5b2a9060 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:33.443421 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0a63096b-a117-4a40-b224-d4dc5b2a9060 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:33.443896 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0a63096b-a117-4a40-b224-d4dc5b2a9060 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:33.444580 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0a63096b-a117-4a40-b224-d4dc5b2a9060 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:33.445034 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0a63096b-a117-4a40-b224-d4dc5b2a9060 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:33.445460 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0a63096b-a117-4a40-b224-d4dc5b2a9060 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:33.574929 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-0a63096b-a117-4a40-b224-d4dc5b2a9060 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:33.583194 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-0a63096b-a117-4a40-b224-d4dc5b2a9060 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.150638 Sep 21 12:21:33.583761 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 54/110] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:33 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:33.726371 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-7658ebb1-d877-421f-964b-0909d1b673c0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:33.726982 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-7658ebb1-d877-421f-964b-0909d1b673c0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:33.733099 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7658ebb1-d877-421f-964b-0909d1b673c0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:33.733585 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7658ebb1-d877-421f-964b-0909d1b673c0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:33.734025 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7658ebb1-d877-421f-964b-0909d1b673c0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:33.734712 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7658ebb1-d877-421f-964b-0909d1b673c0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:33.735167 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7658ebb1-d877-421f-964b-0909d1b673c0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:33.735594 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7658ebb1-d877-421f-964b-0909d1b673c0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:33.865888 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-7658ebb1-d877-421f-964b-0909d1b673c0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:33.874581 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-7658ebb1-d877-421f-964b-0909d1b673c0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:33.876080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-7658ebb1-d877-421f-964b-0909d1b673c0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:33.877229 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-7658ebb1-d877-421f-964b-0909d1b673c0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.154717 Sep 21 12:21:33.877828 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 57/111] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:33 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:21:34.029645 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-7abae772-3e3d-44ed-be45-e7058e45f5e8 req-12c55378-35cd-4304-bc03-1f5c4d836bd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b11d666e-1c68-4889-b80e-a66aa10e05e9", "tag": "9b27a8b0-6e14-43db-b7d2-00fb7465cce0"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:21:34.041731 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-7abae772-3e3d-44ed-be45-e7058e45f5e8 req-12c55378-35cd-4304-bc03-1f5c4d836bd3 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:34.042214 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-7abae772-3e3d-44ed-be45-e7058e45f5e8 req-12c55378-35cd-4304-bc03-1f5c4d836bd3 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:34.042648 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-7abae772-3e3d-44ed-be45-e7058e45f5e8 req-12c55378-35cd-4304-bc03-1f5c4d836bd3 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:34.062025 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-7abae772-3e3d-44ed-be45-e7058e45f5e8 req-12c55378-35cd-4304-bc03-1f5c4d836bd3 service nova] Creating event network-changed:9b27a8b0-6e14-43db-b7d2-00fb7465cce0 for instance b11d666e-1c68-4889-b80e-a66aa10e05e9 on hv-cinder-85867 Sep 21 12:21:34.062543 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-7abae772-3e3d-44ed-be45-e7058e45f5e8 req-12c55378-35cd-4304-bc03-1f5c4d836bd3 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120463) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 21 12:21:34.062939 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-7abae772-3e3d-44ed-be45-e7058e45f5e8 req-12c55378-35cd-4304-bc03-1f5c4d836bd3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120463) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 21 12:21:34.063973 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7583e53d-da79-4aa0-a38e-69ea11f4b4ef None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:34.064435 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7583e53d-da79-4aa0-a38e-69ea11f4b4ef None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:34.064865 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7583e53d-da79-4aa0-a38e-69ea11f4b4ef None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:34.065580 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7583e53d-da79-4aa0-a38e-69ea11f4b4ef None None] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:34.066032 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7583e53d-da79-4aa0-a38e-69ea11f4b4ef None None] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:34.066458 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7583e53d-da79-4aa0-a38e-69ea11f4b4ef None None] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:34.075152 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.compute.rpcapi [None req-7583e53d-da79-4aa0-a38e-69ea11f4b4ef None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 21 12:21:34.076734 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7583e53d-da79-4aa0-a38e-69ea11f4b4ef None None] Releasing lock "compute-rpcapi-router" {{(pid=120463) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 21 12:21:34.091349 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-7583e53d-da79-4aa0-a38e-69ea11f4b4ef None None] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065479 Sep 21 12:21:34.091980 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 55/112] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:21:34.442296 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-02cab1b5-d16f-4508-9583-d2c31e1bb490 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:34.442903 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-02cab1b5-d16f-4508-9583-d2c31e1bb490 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:34.449015 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-02cab1b5-d16f-4508-9583-d2c31e1bb490 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:34.449496 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-02cab1b5-d16f-4508-9583-d2c31e1bb490 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:34.449924 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-02cab1b5-d16f-4508-9583-d2c31e1bb490 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:34.450598 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-02cab1b5-d16f-4508-9583-d2c31e1bb490 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:34.451045 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-02cab1b5-d16f-4508-9583-d2c31e1bb490 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:34.451465 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-02cab1b5-d16f-4508-9583-d2c31e1bb490 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:34.580226 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-02cab1b5-d16f-4508-9583-d2c31e1bb490 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:34.588736 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-02cab1b5-d16f-4508-9583-d2c31e1bb490 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.149413 Sep 21 12:21:34.589380 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 58/113] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:34 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:34.607655 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-fe3b5671-31ba-4451-bc53-cf0f17514e5b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:34.608428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-fe3b5671-31ba-4451-bc53-cf0f17514e5b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:34.615076 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fe3b5671-31ba-4451-bc53-cf0f17514e5b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:34.615566 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fe3b5671-31ba-4451-bc53-cf0f17514e5b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:34.616037 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fe3b5671-31ba-4451-bc53-cf0f17514e5b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:34.616730 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fe3b5671-31ba-4451-bc53-cf0f17514e5b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:34.617187 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fe3b5671-31ba-4451-bc53-cf0f17514e5b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:34.617614 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fe3b5671-31ba-4451-bc53-cf0f17514e5b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:34.910454 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-03c623c2-80cb-43c7-b388-86e791155eab tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:34.911290 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-03c623c2-80cb-43c7-b388-86e791155eab tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:34.917928 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-03c623c2-80cb-43c7-b388-86e791155eab tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:34.918414 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-03c623c2-80cb-43c7-b388-86e791155eab tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:34.919103 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-03c623c2-80cb-43c7-b388-86e791155eab tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:34.920566 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-03c623c2-80cb-43c7-b388-86e791155eab tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:34.921376 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-03c623c2-80cb-43c7-b388-86e791155eab tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:34.921987 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-03c623c2-80cb-43c7-b388-86e791155eab tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:34.927246 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-fe3b5671-31ba-4451-bc53-cf0f17514e5b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:34.936160 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-fe3b5671-31ba-4451-bc53-cf0f17514e5b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.333567 Sep 21 12:21:34.942146 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 56/114] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:34 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:21:35.325156 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-03c623c2-80cb-43c7-b388-86e791155eab tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:35.334036 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-03c623c2-80cb-43c7-b388-86e791155eab tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:35.335514 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-03c623c2-80cb-43c7-b388-86e791155eab tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:35.336659 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-03c623c2-80cb-43c7-b388-86e791155eab tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.434331 Sep 21 12:21:35.337325 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 59/115] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:34 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:21:35.614026 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-2b2c2023-84b1-4305-8056-5890d8304b96 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:35.614651 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-2b2c2023-84b1-4305-8056-5890d8304b96 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:35.621283 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2b2c2023-84b1-4305-8056-5890d8304b96 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:35.621689 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2b2c2023-84b1-4305-8056-5890d8304b96 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:35.622131 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2b2c2023-84b1-4305-8056-5890d8304b96 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:35.622863 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2b2c2023-84b1-4305-8056-5890d8304b96 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:35.623329 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2b2c2023-84b1-4305-8056-5890d8304b96 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:35.623769 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2b2c2023-84b1-4305-8056-5890d8304b96 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:35.764710 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-2b2c2023-84b1-4305-8056-5890d8304b96 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:35.773482 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-2b2c2023-84b1-4305-8056-5890d8304b96 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.163728 Sep 21 12:21:35.774076 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 57/116] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:35 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:35.964102 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-04e72a16-7a1e-498d-b72e-f6f943571561 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:35.964708 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-04e72a16-7a1e-498d-b72e-f6f943571561 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:35.971228 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-04e72a16-7a1e-498d-b72e-f6f943571561 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:35.971707 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-04e72a16-7a1e-498d-b72e-f6f943571561 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:35.972158 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-04e72a16-7a1e-498d-b72e-f6f943571561 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:35.972834 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-04e72a16-7a1e-498d-b72e-f6f943571561 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:35.973281 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-04e72a16-7a1e-498d-b72e-f6f943571561 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:35.973701 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-04e72a16-7a1e-498d-b72e-f6f943571561 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:36.103593 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-04e72a16-7a1e-498d-b72e-f6f943571561 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:36.112016 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-04e72a16-7a1e-498d-b72e-f6f943571561 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.151663 Sep 21 12:21:36.112581 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 60/117] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:35 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:21:36.364162 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-d795a809-22e5-4282-8f1d-15fda10a7550 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:36.364768 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-d795a809-22e5-4282-8f1d-15fda10a7550 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:36.370724 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d795a809-22e5-4282-8f1d-15fda10a7550 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:36.371197 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d795a809-22e5-4282-8f1d-15fda10a7550 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:36.371628 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d795a809-22e5-4282-8f1d-15fda10a7550 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:36.372333 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d795a809-22e5-4282-8f1d-15fda10a7550 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:36.372782 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d795a809-22e5-4282-8f1d-15fda10a7550 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:36.373204 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d795a809-22e5-4282-8f1d-15fda10a7550 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:36.502214 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-d795a809-22e5-4282-8f1d-15fda10a7550 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:36.510204 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-d795a809-22e5-4282-8f1d-15fda10a7550 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:36.511646 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-d795a809-22e5-4282-8f1d-15fda10a7550 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:36.512856 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-d795a809-22e5-4282-8f1d-15fda10a7550 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.152599 Sep 21 12:21:36.514083 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 58/118] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:36 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:21:36.796685 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-aad6845f-f395-4f60-8394-6ef1417cba96 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:36.797299 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-aad6845f-f395-4f60-8394-6ef1417cba96 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:36.803317 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-aad6845f-f395-4f60-8394-6ef1417cba96 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:36.803833 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-aad6845f-f395-4f60-8394-6ef1417cba96 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:36.804276 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-aad6845f-f395-4f60-8394-6ef1417cba96 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:36.804999 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-aad6845f-f395-4f60-8394-6ef1417cba96 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:36.805459 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-aad6845f-f395-4f60-8394-6ef1417cba96 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:36.805888 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-aad6845f-f395-4f60-8394-6ef1417cba96 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:36.932793 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-aad6845f-f395-4f60-8394-6ef1417cba96 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:36.940896 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-aad6845f-f395-4f60-8394-6ef1417cba96 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.148025 Sep 21 12:21:36.941463 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 61/119] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:36 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:37.134607 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-9df85bbe-a553-4ccd-a7a7-2ba11c76feb3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:37.135389 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-9df85bbe-a553-4ccd-a7a7-2ba11c76feb3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:37.142231 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9df85bbe-a553-4ccd-a7a7-2ba11c76feb3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:37.142794 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9df85bbe-a553-4ccd-a7a7-2ba11c76feb3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:37.143300 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9df85bbe-a553-4ccd-a7a7-2ba11c76feb3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:37.144098 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9df85bbe-a553-4ccd-a7a7-2ba11c76feb3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:37.144708 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9df85bbe-a553-4ccd-a7a7-2ba11c76feb3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:37.145136 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9df85bbe-a553-4ccd-a7a7-2ba11c76feb3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:37.428938 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-9df85bbe-a553-4ccd-a7a7-2ba11c76feb3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:37.437113 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-9df85bbe-a553-4ccd-a7a7-2ba11c76feb3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.306398 Sep 21 12:21:37.437686 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 59/120] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:37 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:37.538585 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-cadca780-bfeb-45c6-9374-437c7a022fde tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:37.539196 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-cadca780-bfeb-45c6-9374-437c7a022fde tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:37.545627 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-cadca780-bfeb-45c6-9374-437c7a022fde tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:37.546135 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-cadca780-bfeb-45c6-9374-437c7a022fde tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:37.546571 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-cadca780-bfeb-45c6-9374-437c7a022fde tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:37.547255 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-cadca780-bfeb-45c6-9374-437c7a022fde tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:37.547712 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-cadca780-bfeb-45c6-9374-437c7a022fde tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:37.548167 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-cadca780-bfeb-45c6-9374-437c7a022fde tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:37.836899 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-cadca780-bfeb-45c6-9374-437c7a022fde tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:37.845553 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-cadca780-bfeb-45c6-9374-437c7a022fde tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:37.846995 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-cadca780-bfeb-45c6-9374-437c7a022fde tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:37.848124 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-cadca780-bfeb-45c6-9374-437c7a022fde tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.313393 Sep 21 12:21:37.848690 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 62/121] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:37 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:21:37.963961 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-6776491a-00c6-49f6-882f-c0f8a2b57e06 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:37.964498 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-6776491a-00c6-49f6-882f-c0f8a2b57e06 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:37.970805 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6776491a-00c6-49f6-882f-c0f8a2b57e06 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:37.971272 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6776491a-00c6-49f6-882f-c0f8a2b57e06 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:37.971699 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6776491a-00c6-49f6-882f-c0f8a2b57e06 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:37.972395 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6776491a-00c6-49f6-882f-c0f8a2b57e06 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:37.972838 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6776491a-00c6-49f6-882f-c0f8a2b57e06 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:37.973253 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6776491a-00c6-49f6-882f-c0f8a2b57e06 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:38.101335 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-6776491a-00c6-49f6-882f-c0f8a2b57e06 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:38.109235 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-6776491a-00c6-49f6-882f-c0f8a2b57e06 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.149182 Sep 21 12:21:38.109810 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 60/122] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:37 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:38.460015 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-8337c242-13b9-495c-8fc7-f42323069daf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:38.460622 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-8337c242-13b9-495c-8fc7-f42323069daf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:38.466663 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8337c242-13b9-495c-8fc7-f42323069daf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:38.467163 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8337c242-13b9-495c-8fc7-f42323069daf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:38.467591 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8337c242-13b9-495c-8fc7-f42323069daf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:38.468318 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8337c242-13b9-495c-8fc7-f42323069daf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:38.468761 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8337c242-13b9-495c-8fc7-f42323069daf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:38.469177 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8337c242-13b9-495c-8fc7-f42323069daf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:38.597526 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-8337c242-13b9-495c-8fc7-f42323069daf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:38.605585 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-8337c242-13b9-495c-8fc7-f42323069daf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.149651 Sep 21 12:21:38.606197 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 63/123] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:38 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:38.873506 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-38fca4ae-d9e4-45d9-beca-552de6ee9ee2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:38.874154 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-38fca4ae-d9e4-45d9-beca-552de6ee9ee2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:38.880312 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-38fca4ae-d9e4-45d9-beca-552de6ee9ee2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:38.880803 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-38fca4ae-d9e4-45d9-beca-552de6ee9ee2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:38.881243 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-38fca4ae-d9e4-45d9-beca-552de6ee9ee2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:38.881941 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-38fca4ae-d9e4-45d9-beca-552de6ee9ee2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:38.882394 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-38fca4ae-d9e4-45d9-beca-552de6ee9ee2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:38.882819 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-38fca4ae-d9e4-45d9-beca-552de6ee9ee2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:39.011129 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-38fca4ae-d9e4-45d9-beca-552de6ee9ee2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:39.019218 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-38fca4ae-d9e4-45d9-beca-552de6ee9ee2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:39.020643 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-38fca4ae-d9e4-45d9-beca-552de6ee9ee2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:39.021746 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-38fca4ae-d9e4-45d9-beca-552de6ee9ee2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.152809 Sep 21 12:21:39.022310 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 61/124] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:38 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:21:39.131655 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-acf5b99e-57f9-4288-a6d0-a60699726b5c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:39.132290 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-acf5b99e-57f9-4288-a6d0-a60699726b5c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:39.138850 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-acf5b99e-57f9-4288-a6d0-a60699726b5c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:39.139387 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-acf5b99e-57f9-4288-a6d0-a60699726b5c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:39.139766 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-acf5b99e-57f9-4288-a6d0-a60699726b5c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:39.140465 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-acf5b99e-57f9-4288-a6d0-a60699726b5c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:39.140910 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-acf5b99e-57f9-4288-a6d0-a60699726b5c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:39.141330 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-acf5b99e-57f9-4288-a6d0-a60699726b5c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:39.275912 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-acf5b99e-57f9-4288-a6d0-a60699726b5c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:39.284673 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-acf5b99e-57f9-4288-a6d0-a60699726b5c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.156990 Sep 21 12:21:39.285243 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 64/125] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:39 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:39.628648 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-247bb208-d574-400a-a354-7f8303c14ef3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:39.629756 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-247bb208-d574-400a-a354-7f8303c14ef3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:39.636187 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-247bb208-d574-400a-a354-7f8303c14ef3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:39.636666 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-247bb208-d574-400a-a354-7f8303c14ef3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:39.637100 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-247bb208-d574-400a-a354-7f8303c14ef3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:39.639330 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-247bb208-d574-400a-a354-7f8303c14ef3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:39.639330 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-247bb208-d574-400a-a354-7f8303c14ef3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:39.639520 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-247bb208-d574-400a-a354-7f8303c14ef3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:39.773249 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-247bb208-d574-400a-a354-7f8303c14ef3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:39.781384 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-247bb208-d574-400a-a354-7f8303c14ef3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.156944 Sep 21 12:21:39.781950 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 62/126] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:39 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:40.045590 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-8047dd54-9b1b-4e6c-97ba-515ebf3f5568 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:40.046183 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-8047dd54-9b1b-4e6c-97ba-515ebf3f5568 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:40.052875 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8047dd54-9b1b-4e6c-97ba-515ebf3f5568 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:40.053468 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8047dd54-9b1b-4e6c-97ba-515ebf3f5568 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:40.053796 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8047dd54-9b1b-4e6c-97ba-515ebf3f5568 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:40.054519 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8047dd54-9b1b-4e6c-97ba-515ebf3f5568 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:40.054968 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8047dd54-9b1b-4e6c-97ba-515ebf3f5568 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:40.055404 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8047dd54-9b1b-4e6c-97ba-515ebf3f5568 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:40.184039 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-8047dd54-9b1b-4e6c-97ba-515ebf3f5568 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:40.193115 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-8047dd54-9b1b-4e6c-97ba-515ebf3f5568 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:40.194772 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-8047dd54-9b1b-4e6c-97ba-515ebf3f5568 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:40.195927 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-8047dd54-9b1b-4e6c-97ba-515ebf3f5568 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.154256 Sep 21 12:21:40.196487 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 65/127] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:40 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:21:40.308999 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-d8ce365f-b76e-468f-9614-228afdc7660f tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:40.309620 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-d8ce365f-b76e-468f-9614-228afdc7660f tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:40.316152 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d8ce365f-b76e-468f-9614-228afdc7660f tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:40.316638 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d8ce365f-b76e-468f-9614-228afdc7660f tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:40.317074 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d8ce365f-b76e-468f-9614-228afdc7660f tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:40.317764 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d8ce365f-b76e-468f-9614-228afdc7660f tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:40.318216 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d8ce365f-b76e-468f-9614-228afdc7660f tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:40.318639 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d8ce365f-b76e-468f-9614-228afdc7660f tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:40.447511 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-d8ce365f-b76e-468f-9614-228afdc7660f tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:40.455210 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-d8ce365f-b76e-468f-9614-228afdc7660f tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.150193 Sep 21 12:21:40.456063 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 63/128] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:40 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:40.804209 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-4f98a437-69e5-4cac-93d6-4b817bf639f3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:40.804829 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-4f98a437-69e5-4cac-93d6-4b817bf639f3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:40.810735 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4f98a437-69e5-4cac-93d6-4b817bf639f3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:40.811209 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4f98a437-69e5-4cac-93d6-4b817bf639f3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:40.811642 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4f98a437-69e5-4cac-93d6-4b817bf639f3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:40.812349 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4f98a437-69e5-4cac-93d6-4b817bf639f3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:40.812794 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4f98a437-69e5-4cac-93d6-4b817bf639f3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:40.813213 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4f98a437-69e5-4cac-93d6-4b817bf639f3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:40.946670 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-4f98a437-69e5-4cac-93d6-4b817bf639f3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:40.954986 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-4f98a437-69e5-4cac-93d6-4b817bf639f3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.154361 Sep 21 12:21:40.955654 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 66/129] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:40 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:41.222620 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-c3539e1d-e77f-4898-a8b6-6cafd01aaece tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:41.223331 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-c3539e1d-e77f-4898-a8b6-6cafd01aaece tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:41.229326 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c3539e1d-e77f-4898-a8b6-6cafd01aaece tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:41.229811 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c3539e1d-e77f-4898-a8b6-6cafd01aaece tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:41.230249 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c3539e1d-e77f-4898-a8b6-6cafd01aaece tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:41.230936 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c3539e1d-e77f-4898-a8b6-6cafd01aaece tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:41.231397 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c3539e1d-e77f-4898-a8b6-6cafd01aaece tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:41.231848 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c3539e1d-e77f-4898-a8b6-6cafd01aaece tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:41.369990 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-c3539e1d-e77f-4898-a8b6-6cafd01aaece tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:41.378781 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-c3539e1d-e77f-4898-a8b6-6cafd01aaece tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:41.380308 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-c3539e1d-e77f-4898-a8b6-6cafd01aaece tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:41.381416 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-c3539e1d-e77f-4898-a8b6-6cafd01aaece tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.163188 Sep 21 12:21:41.381983 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 64/130] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:41 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:21:41.477533 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-fad145e9-1094-4aee-a864-7278189d272c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:41.478145 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-fad145e9-1094-4aee-a864-7278189d272c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:41.480111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell0:SELECT=2 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:41.485493 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fad145e9-1094-4aee-a864-7278189d272c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:41.485977 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fad145e9-1094-4aee-a864-7278189d272c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:41.486415 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fad145e9-1094-4aee-a864-7278189d272c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:41.487103 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fad145e9-1094-4aee-a864-7278189d272c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:41.487555 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fad145e9-1094-4aee-a864-7278189d272c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:41.488028 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fad145e9-1094-4aee-a864-7278189d272c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:41.613750 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-fad145e9-1094-4aee-a864-7278189d272c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:41.621653 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-fad145e9-1094-4aee-a864-7278189d272c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.147928 Sep 21 12:21:41.622736 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 67/131] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:41 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:41.978516 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-cb745aef-cb84-4072-a03a-57f2e96e0fb3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:41.979126 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-cb745aef-cb84-4072-a03a-57f2e96e0fb3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:41.987022 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cb745aef-cb84-4072-a03a-57f2e96e0fb3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:41.987504 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cb745aef-cb84-4072-a03a-57f2e96e0fb3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:41.987971 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cb745aef-cb84-4072-a03a-57f2e96e0fb3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:41.988663 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cb745aef-cb84-4072-a03a-57f2e96e0fb3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:41.989116 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cb745aef-cb84-4072-a03a-57f2e96e0fb3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:41.989539 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cb745aef-cb84-4072-a03a-57f2e96e0fb3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:42.138371 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-cb745aef-cb84-4072-a03a-57f2e96e0fb3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:42.145620 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-cb745aef-cb84-4072-a03a-57f2e96e0fb3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.170779 Sep 21 12:21:42.146435 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 65/132] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:41 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:42.408312 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-138c8358-296e-4407-b253-43302d0c84ee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:42.413608 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-138c8358-296e-4407-b253-43302d0c84ee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:42.435164 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-138c8358-296e-4407-b253-43302d0c84ee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:42.435656 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-138c8358-296e-4407-b253-43302d0c84ee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:42.436119 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-138c8358-296e-4407-b253-43302d0c84ee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:42.436816 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-138c8358-296e-4407-b253-43302d0c84ee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:42.437254 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-138c8358-296e-4407-b253-43302d0c84ee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:42.439831 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-138c8358-296e-4407-b253-43302d0c84ee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:42.645669 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-254de0c2-11d5-40af-a370-8a401d7f46c8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:42.646415 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-254de0c2-11d5-40af-a370-8a401d7f46c8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:42.659123 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-254de0c2-11d5-40af-a370-8a401d7f46c8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:42.659641 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-254de0c2-11d5-40af-a370-8a401d7f46c8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:42.661267 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-254de0c2-11d5-40af-a370-8a401d7f46c8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:42.663146 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-254de0c2-11d5-40af-a370-8a401d7f46c8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:42.663636 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-254de0c2-11d5-40af-a370-8a401d7f46c8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:42.664111 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-254de0c2-11d5-40af-a370-8a401d7f46c8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:43.016873 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-254de0c2-11d5-40af-a370-8a401d7f46c8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:43.029628 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-254de0c2-11d5-40af-a370-8a401d7f46c8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.387879 Sep 21 12:21:43.030299 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 66/133] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:42 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:21:43.168745 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-02a1d5dd-2b19-421a-a5ff-9bd173d05cb0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:43.170017 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-02a1d5dd-2b19-421a-a5ff-9bd173d05cb0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:43.176042 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-02a1d5dd-2b19-421a-a5ff-9bd173d05cb0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:43.176534 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-02a1d5dd-2b19-421a-a5ff-9bd173d05cb0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:43.176976 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-02a1d5dd-2b19-421a-a5ff-9bd173d05cb0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:43.177671 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-02a1d5dd-2b19-421a-a5ff-9bd173d05cb0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:43.178131 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-02a1d5dd-2b19-421a-a5ff-9bd173d05cb0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:43.178558 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-02a1d5dd-2b19-421a-a5ff-9bd173d05cb0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:43.188415 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-138c8358-296e-4407-b253-43302d0c84ee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:43.197375 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-138c8358-296e-4407-b253-43302d0c84ee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:43.198941 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-138c8358-296e-4407-b253-43302d0c84ee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:43.200243 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-138c8358-296e-4407-b253-43302d0c84ee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.797588 Sep 21 12:21:43.200904 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 68/134] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:42 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:21:43.314350 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-02a1d5dd-2b19-421a-a5ff-9bd173d05cb0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:43.322633 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-02a1d5dd-2b19-421a-a5ff-9bd173d05cb0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.157756 Sep 21 12:21:43.323215 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 67/135] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:43 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:21:44.054883 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-862b2cc4-7727-4364-bc10-1513ef7e7790 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:44.055498 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-862b2cc4-7727-4364-bc10-1513ef7e7790 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:44.061574 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-862b2cc4-7727-4364-bc10-1513ef7e7790 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:44.062062 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-862b2cc4-7727-4364-bc10-1513ef7e7790 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:44.062502 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-862b2cc4-7727-4364-bc10-1513ef7e7790 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:44.063197 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-862b2cc4-7727-4364-bc10-1513ef7e7790 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:44.063652 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-862b2cc4-7727-4364-bc10-1513ef7e7790 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:44.064108 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-862b2cc4-7727-4364-bc10-1513ef7e7790 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:44.203644 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-862b2cc4-7727-4364-bc10-1513ef7e7790 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:44.211458 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-862b2cc4-7727-4364-bc10-1513ef7e7790 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.160420 Sep 21 12:21:44.212057 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 69/136] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:44 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:44.225618 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-49ffd686-dd39-4362-8a79-96c82fd1143a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:44.226232 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-49ffd686-dd39-4362-8a79-96c82fd1143a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:44.228314 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell0:SELECT=2 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:44.233858 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-49ffd686-dd39-4362-8a79-96c82fd1143a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:44.234344 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-49ffd686-dd39-4362-8a79-96c82fd1143a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:44.234783 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-49ffd686-dd39-4362-8a79-96c82fd1143a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:44.235474 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-49ffd686-dd39-4362-8a79-96c82fd1143a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:44.235975 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-49ffd686-dd39-4362-8a79-96c82fd1143a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:44.236403 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-49ffd686-dd39-4362-8a79-96c82fd1143a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:44.346978 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-e3b38e83-4171-4cd8-b3ee-b772d4a91da9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:44.347592 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-e3b38e83-4171-4cd8-b3ee-b772d4a91da9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:44.353787 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e3b38e83-4171-4cd8-b3ee-b772d4a91da9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:44.354278 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e3b38e83-4171-4cd8-b3ee-b772d4a91da9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:44.354721 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e3b38e83-4171-4cd8-b3ee-b772d4a91da9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:44.355417 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e3b38e83-4171-4cd8-b3ee-b772d4a91da9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:44.355909 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e3b38e83-4171-4cd8-b3ee-b772d4a91da9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:44.356347 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e3b38e83-4171-4cd8-b3ee-b772d4a91da9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:44.360459 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=100 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:44.364500 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-49ffd686-dd39-4362-8a79-96c82fd1143a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:44.367932 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=100 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:44.374342 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-49ffd686-dd39-4362-8a79-96c82fd1143a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:44.375810 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-49ffd686-dd39-4362-8a79-96c82fd1143a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:44.376924 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-49ffd686-dd39-4362-8a79-96c82fd1143a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.155285 Sep 21 12:21:44.377501 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 68/137] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:44 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:21:44.489248 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-e3b38e83-4171-4cd8-b3ee-b772d4a91da9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:44.496787 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-e3b38e83-4171-4cd8-b3ee-b772d4a91da9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.153664 Sep 21 12:21:44.497849 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 70/138] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:44 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:21:45.237236 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-27f791d9-c36f-44c8-bc13-4b0d4c6618f0 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:45.237952 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-27f791d9-c36f-44c8-bc13-4b0d4c6618f0 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:45.244604 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-27f791d9-c36f-44c8-bc13-4b0d4c6618f0 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:45.245089 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-27f791d9-c36f-44c8-bc13-4b0d4c6618f0 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:45.245527 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-27f791d9-c36f-44c8-bc13-4b0d4c6618f0 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:45.246223 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-27f791d9-c36f-44c8-bc13-4b0d4c6618f0 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:45.246680 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-27f791d9-c36f-44c8-bc13-4b0d4c6618f0 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:45.247190 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-27f791d9-c36f-44c8-bc13-4b0d4c6618f0 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:45.376749 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-27f791d9-c36f-44c8-bc13-4b0d4c6618f0 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:45.384329 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-27f791d9-c36f-44c8-bc13-4b0d4c6618f0 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.151608 Sep 21 12:21:45.384900 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 69/139] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:45 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:45.402227 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-486e67bf-8d55-4020-94b8-43607027382f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:45.402837 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-486e67bf-8d55-4020-94b8-43607027382f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:45.409757 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-486e67bf-8d55-4020-94b8-43607027382f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:45.409878 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-486e67bf-8d55-4020-94b8-43607027382f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:45.410234 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-486e67bf-8d55-4020-94b8-43607027382f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:45.410927 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-486e67bf-8d55-4020-94b8-43607027382f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:45.411380 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-486e67bf-8d55-4020-94b8-43607027382f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:45.411864 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-486e67bf-8d55-4020-94b8-43607027382f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:45.520077 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-ba8c3bab-e519-47da-8bda-807b89c04a4b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:45.520726 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-ba8c3bab-e519-47da-8bda-807b89c04a4b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:45.527078 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ba8c3bab-e519-47da-8bda-807b89c04a4b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:45.527575 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ba8c3bab-e519-47da-8bda-807b89c04a4b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:45.528050 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ba8c3bab-e519-47da-8bda-807b89c04a4b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:45.529323 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ba8c3bab-e519-47da-8bda-807b89c04a4b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:45.529787 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ba8c3bab-e519-47da-8bda-807b89c04a4b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:45.530214 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ba8c3bab-e519-47da-8bda-807b89c04a4b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:45.543439 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-486e67bf-8d55-4020-94b8-43607027382f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:45.553407 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-486e67bf-8d55-4020-94b8-43607027382f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:45.555182 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-486e67bf-8d55-4020-94b8-43607027382f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:45.556542 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-486e67bf-8d55-4020-94b8-43607027382f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.158152 Sep 21 12:21:45.557327 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 71/140] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:45 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:21:45.660232 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-ba8c3bab-e519-47da-8bda-807b89c04a4b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:45.667748 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-ba8c3bab-e519-47da-8bda-807b89c04a4b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.151737 Sep 21 12:21:45.668333 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 70/141] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:45 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:21:46.406509 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-cf86b3c1-d6dc-4c8e-b324-fdf28e851f78 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:46.407047 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-cf86b3c1-d6dc-4c8e-b324-fdf28e851f78 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:46.413112 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-cf86b3c1-d6dc-4c8e-b324-fdf28e851f78 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:46.413607 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-cf86b3c1-d6dc-4c8e-b324-fdf28e851f78 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:46.414047 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-cf86b3c1-d6dc-4c8e-b324-fdf28e851f78 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:46.414743 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-cf86b3c1-d6dc-4c8e-b324-fdf28e851f78 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:46.415197 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-cf86b3c1-d6dc-4c8e-b324-fdf28e851f78 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:46.415624 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-cf86b3c1-d6dc-4c8e-b324-fdf28e851f78 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:46.549624 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-cf86b3c1-d6dc-4c8e-b324-fdf28e851f78 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:46.557428 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-cf86b3c1-d6dc-4c8e-b324-fdf28e851f78 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.154801 Sep 21 12:21:46.558120 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 72/142] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:46 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:46.581980 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-3d15d0ea-2cec-4804-b495-d29f5a1f9540 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:46.582849 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-3d15d0ea-2cec-4804-b495-d29f5a1f9540 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:46.589108 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3d15d0ea-2cec-4804-b495-d29f5a1f9540 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:46.589606 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3d15d0ea-2cec-4804-b495-d29f5a1f9540 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:46.590050 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3d15d0ea-2cec-4804-b495-d29f5a1f9540 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:46.590766 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3d15d0ea-2cec-4804-b495-d29f5a1f9540 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:46.591223 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3d15d0ea-2cec-4804-b495-d29f5a1f9540 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:46.591658 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3d15d0ea-2cec-4804-b495-d29f5a1f9540 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:46.690080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-3da2637a-51d2-4659-9a78-6b7749768fde tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:46.690821 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-3da2637a-51d2-4659-9a78-6b7749768fde tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:46.697045 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3da2637a-51d2-4659-9a78-6b7749768fde tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:46.697625 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3da2637a-51d2-4659-9a78-6b7749768fde tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:46.698234 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3da2637a-51d2-4659-9a78-6b7749768fde tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:46.699008 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3da2637a-51d2-4659-9a78-6b7749768fde tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:46.699530 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3da2637a-51d2-4659-9a78-6b7749768fde tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:46.700072 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3da2637a-51d2-4659-9a78-6b7749768fde tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:46.721570 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-3d15d0ea-2cec-4804-b495-d29f5a1f9540 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:46.729681 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-3d15d0ea-2cec-4804-b495-d29f5a1f9540 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:46.731141 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-3d15d0ea-2cec-4804-b495-d29f5a1f9540 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:46.732840 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-3d15d0ea-2cec-4804-b495-d29f5a1f9540 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.155036 Sep 21 12:21:46.733405 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 71/143] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:46 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:21:46.836415 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-3da2637a-51d2-4659-9a78-6b7749768fde tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:46.845490 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-3da2637a-51d2-4659-9a78-6b7749768fde tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.159194 Sep 21 12:21:46.846096 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 73/144] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:46 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:21:47.581651 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-6670ed62-f329-4b2f-bf8a-f1b793a7eed2 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:47.582552 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-6670ed62-f329-4b2f-bf8a-f1b793a7eed2 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:47.588719 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6670ed62-f329-4b2f-bf8a-f1b793a7eed2 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:47.589317 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6670ed62-f329-4b2f-bf8a-f1b793a7eed2 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:47.589645 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6670ed62-f329-4b2f-bf8a-f1b793a7eed2 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:47.590340 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6670ed62-f329-4b2f-bf8a-f1b793a7eed2 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:47.590798 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6670ed62-f329-4b2f-bf8a-f1b793a7eed2 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:47.591230 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6670ed62-f329-4b2f-bf8a-f1b793a7eed2 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:47.721468 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-6670ed62-f329-4b2f-bf8a-f1b793a7eed2 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:47.729246 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-6670ed62-f329-4b2f-bf8a-f1b793a7eed2 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.151511 Sep 21 12:21:47.729802 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 72/145] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:47 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:47.759597 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-c77a75c8-0955-4840-901e-1f3b4b392bf1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:47.760164 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-c77a75c8-0955-4840-901e-1f3b4b392bf1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:47.766956 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c77a75c8-0955-4840-901e-1f3b4b392bf1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:47.767448 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c77a75c8-0955-4840-901e-1f3b4b392bf1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:47.767934 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c77a75c8-0955-4840-901e-1f3b4b392bf1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:47.768644 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c77a75c8-0955-4840-901e-1f3b4b392bf1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:47.769107 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c77a75c8-0955-4840-901e-1f3b4b392bf1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:47.769539 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c77a75c8-0955-4840-901e-1f3b4b392bf1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:47.868227 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-40527796-ff1c-49d3-ad95-c4b89f8280ca tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:47.868833 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-40527796-ff1c-49d3-ad95-c4b89f8280ca tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:47.875477 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-40527796-ff1c-49d3-ad95-c4b89f8280ca tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:47.876027 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-40527796-ff1c-49d3-ad95-c4b89f8280ca tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:47.876633 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-40527796-ff1c-49d3-ad95-c4b89f8280ca tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:47.877572 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-40527796-ff1c-49d3-ad95-c4b89f8280ca tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:47.878032 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-40527796-ff1c-49d3-ad95-c4b89f8280ca tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:47.878526 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-40527796-ff1c-49d3-ad95-c4b89f8280ca tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:47.904468 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-c77a75c8-0955-4840-901e-1f3b4b392bf1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:47.912694 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-c77a75c8-0955-4840-901e-1f3b4b392bf1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:47.914151 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-c77a75c8-0955-4840-901e-1f3b4b392bf1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:47.915270 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-c77a75c8-0955-4840-901e-1f3b4b392bf1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.159712 Sep 21 12:21:47.915864 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 74/146] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:47 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:21:48.011392 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-40527796-ff1c-49d3-ad95-c4b89f8280ca tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:48.019238 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-40527796-ff1c-49d3-ad95-c4b89f8280ca tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.154896 Sep 21 12:21:48.019847 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 73/147] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:47 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:21:48.753693 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-199c7710-8872-4ba8-ad2c-943625b07af6 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:48.754345 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-199c7710-8872-4ba8-ad2c-943625b07af6 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:48.760506 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-199c7710-8872-4ba8-ad2c-943625b07af6 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:48.761080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-199c7710-8872-4ba8-ad2c-943625b07af6 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:48.761420 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-199c7710-8872-4ba8-ad2c-943625b07af6 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:48.762120 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-199c7710-8872-4ba8-ad2c-943625b07af6 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:48.762852 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-199c7710-8872-4ba8-ad2c-943625b07af6 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:48.763645 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-199c7710-8872-4ba8-ad2c-943625b07af6 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:48.909052 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-199c7710-8872-4ba8-ad2c-943625b07af6 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:48.916857 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-199c7710-8872-4ba8-ad2c-943625b07af6 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.167168 Sep 21 12:21:48.917494 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 75/148] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:48 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:48.940397 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-78385f57-aa60-4413-8260-e02244957f1f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:48.941134 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-78385f57-aa60-4413-8260-e02244957f1f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:48.946934 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-78385f57-aa60-4413-8260-e02244957f1f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:48.947410 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-78385f57-aa60-4413-8260-e02244957f1f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:48.947901 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-78385f57-aa60-4413-8260-e02244957f1f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:48.948590 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-78385f57-aa60-4413-8260-e02244957f1f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:48.949037 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-78385f57-aa60-4413-8260-e02244957f1f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:48.949456 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-78385f57-aa60-4413-8260-e02244957f1f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:49.041749 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-1340f69f-76e3-47cd-9a89-2ae612155ca0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:49.042368 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-1340f69f-76e3-47cd-9a89-2ae612155ca0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:49.048953 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1340f69f-76e3-47cd-9a89-2ae612155ca0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:49.049443 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1340f69f-76e3-47cd-9a89-2ae612155ca0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:49.049885 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1340f69f-76e3-47cd-9a89-2ae612155ca0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:49.050585 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1340f69f-76e3-47cd-9a89-2ae612155ca0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:49.051043 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1340f69f-76e3-47cd-9a89-2ae612155ca0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:49.051469 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1340f69f-76e3-47cd-9a89-2ae612155ca0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:49.079106 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-78385f57-aa60-4413-8260-e02244957f1f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:49.087713 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-78385f57-aa60-4413-8260-e02244957f1f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:49.089198 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-78385f57-aa60-4413-8260-e02244957f1f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:49.090332 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-78385f57-aa60-4413-8260-e02244957f1f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.153883 Sep 21 12:21:49.107853 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 74/149] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:48 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:21:49.176759 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-1340f69f-76e3-47cd-9a89-2ae612155ca0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:49.184377 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-1340f69f-76e3-47cd-9a89-2ae612155ca0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.146385 Sep 21 12:21:49.184951 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 76/150] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:49 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:21:49.941227 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-a2cc23b0-7dfe-4c8b-930c-883d92eb9d08 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:49.943375 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-a2cc23b0-7dfe-4c8b-930c-883d92eb9d08 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:49.949313 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a2cc23b0-7dfe-4c8b-930c-883d92eb9d08 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:49.950810 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a2cc23b0-7dfe-4c8b-930c-883d92eb9d08 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:49.951433 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a2cc23b0-7dfe-4c8b-930c-883d92eb9d08 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:49.952777 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a2cc23b0-7dfe-4c8b-930c-883d92eb9d08 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:49.953380 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a2cc23b0-7dfe-4c8b-930c-883d92eb9d08 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:49.954226 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a2cc23b0-7dfe-4c8b-930c-883d92eb9d08 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:50.108317 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a2cc23b0-7dfe-4c8b-930c-883d92eb9d08 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:50.116327 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-38db519c-2ed8-43a4-9682-9c879af13a07 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:50.116904 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-a2cc23b0-7dfe-4c8b-930c-883d92eb9d08 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.179787 Sep 21 12:21:50.116997 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-38db519c-2ed8-43a4-9682-9c879af13a07 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:50.117248 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 75/151] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:49 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:50.123676 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-38db519c-2ed8-43a4-9682-9c879af13a07 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:50.124192 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-38db519c-2ed8-43a4-9682-9c879af13a07 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:50.124635 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-38db519c-2ed8-43a4-9682-9c879af13a07 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:50.125332 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-38db519c-2ed8-43a4-9682-9c879af13a07 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:50.125791 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-38db519c-2ed8-43a4-9682-9c879af13a07 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:50.126285 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-38db519c-2ed8-43a4-9682-9c879af13a07 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:50.206581 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-1a91f2ad-2f9c-4089-92ce-d51348277013 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:50.207489 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-1a91f2ad-2f9c-4089-92ce-d51348277013 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:50.209360 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=78 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:50.214812 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1a91f2ad-2f9c-4089-92ce-d51348277013 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:50.215576 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1a91f2ad-2f9c-4089-92ce-d51348277013 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:50.216054 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1a91f2ad-2f9c-4089-92ce-d51348277013 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:50.216767 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1a91f2ad-2f9c-4089-92ce-d51348277013 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:50.217228 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1a91f2ad-2f9c-4089-92ce-d51348277013 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:50.217663 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1a91f2ad-2f9c-4089-92ce-d51348277013 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:50.261893 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-38db519c-2ed8-43a4-9682-9c879af13a07 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:50.270182 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-38db519c-2ed8-43a4-9682-9c879af13a07 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:50.271533 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-38db519c-2ed8-43a4-9682-9c879af13a07 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:50.272665 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-38db519c-2ed8-43a4-9682-9c879af13a07 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.160306 Sep 21 12:21:50.273237 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 77/152] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:50 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:21:50.346789 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-1a91f2ad-2f9c-4089-92ce-d51348277013 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:50.354600 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-1a91f2ad-2f9c-4089-92ce-d51348277013 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.152003 Sep 21 12:21:50.355184 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 76/153] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:50 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:21:51.141168 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-cab1e15c-8fa7-4b5e-8696-5b67f93af934 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:51.141844 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-cab1e15c-8fa7-4b5e-8696-5b67f93af934 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:51.143681 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_api:SELECT=76 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:51.148821 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-cab1e15c-8fa7-4b5e-8696-5b67f93af934 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:51.149299 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-cab1e15c-8fa7-4b5e-8696-5b67f93af934 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:51.149759 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-cab1e15c-8fa7-4b5e-8696-5b67f93af934 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:51.150454 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-cab1e15c-8fa7-4b5e-8696-5b67f93af934 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:51.150904 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-cab1e15c-8fa7-4b5e-8696-5b67f93af934 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:51.151326 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-cab1e15c-8fa7-4b5e-8696-5b67f93af934 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:51.278729 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-cab1e15c-8fa7-4b5e-8696-5b67f93af934 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:51.286318 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-cab1e15c-8fa7-4b5e-8696-5b67f93af934 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.149616 Sep 21 12:21:51.286885 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 78/154] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:51 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:51.296678 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-d3be3501-f9f2-4456-9337-d478f8cb6b77 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:51.297373 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-d3be3501-f9f2-4456-9337-d478f8cb6b77 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:51.303320 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d3be3501-f9f2-4456-9337-d478f8cb6b77 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:51.303878 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d3be3501-f9f2-4456-9337-d478f8cb6b77 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:51.304325 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d3be3501-f9f2-4456-9337-d478f8cb6b77 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:51.305009 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d3be3501-f9f2-4456-9337-d478f8cb6b77 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:51.305465 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d3be3501-f9f2-4456-9337-d478f8cb6b77 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:51.305892 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d3be3501-f9f2-4456-9337-d478f8cb6b77 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:51.378104 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-78649b5c-63bc-4a09-ad47-e996f618d40b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:51.378708 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-78649b5c-63bc-4a09-ad47-e996f618d40b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:51.384518 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-78649b5c-63bc-4a09-ad47-e996f618d40b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:51.384997 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-78649b5c-63bc-4a09-ad47-e996f618d40b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:51.385427 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-78649b5c-63bc-4a09-ad47-e996f618d40b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:51.386107 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-78649b5c-63bc-4a09-ad47-e996f618d40b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:51.386555 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-78649b5c-63bc-4a09-ad47-e996f618d40b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:51.386974 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-78649b5c-63bc-4a09-ad47-e996f618d40b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:51.435980 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-d3be3501-f9f2-4456-9337-d478f8cb6b77 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:51.444046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-d3be3501-f9f2-4456-9337-d478f8cb6b77 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:51.445980 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-d3be3501-f9f2-4456-9337-d478f8cb6b77 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:51.446602 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-d3be3501-f9f2-4456-9337-d478f8cb6b77 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.153943 Sep 21 12:21:51.447175 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 77/155] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:51 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:21:51.528095 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-78649b5c-63bc-4a09-ad47-e996f618d40b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:51.535719 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-78649b5c-63bc-4a09-ad47-e996f618d40b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.161413 Sep 21 12:21:51.536308 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 79/156] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:51 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:21:52.308736 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-6a57ee91-f8af-4214-bf96-1f34f9313b0d tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:52.309358 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-6a57ee91-f8af-4214-bf96-1f34f9313b0d tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:52.315178 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6a57ee91-f8af-4214-bf96-1f34f9313b0d tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:52.315661 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6a57ee91-f8af-4214-bf96-1f34f9313b0d tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:52.316128 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6a57ee91-f8af-4214-bf96-1f34f9313b0d tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:52.316815 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6a57ee91-f8af-4214-bf96-1f34f9313b0d tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:52.317265 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6a57ee91-f8af-4214-bf96-1f34f9313b0d tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:52.317692 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6a57ee91-f8af-4214-bf96-1f34f9313b0d tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:52.441671 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-6a57ee91-f8af-4214-bf96-1f34f9313b0d tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:52.449307 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-6a57ee91-f8af-4214-bf96-1f34f9313b0d tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.144520 Sep 21 12:21:52.450446 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 78/157] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:52 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:52.472679 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-9b62b28e-a4b0-442d-a5bb-a8b241736a38 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:52.473351 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-9b62b28e-a4b0-442d-a5bb-a8b241736a38 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:52.479276 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9b62b28e-a4b0-442d-a5bb-a8b241736a38 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:52.479812 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9b62b28e-a4b0-442d-a5bb-a8b241736a38 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:52.480260 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9b62b28e-a4b0-442d-a5bb-a8b241736a38 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:52.481016 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9b62b28e-a4b0-442d-a5bb-a8b241736a38 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:52.481473 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9b62b28e-a4b0-442d-a5bb-a8b241736a38 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:52.481901 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9b62b28e-a4b0-442d-a5bb-a8b241736a38 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:52.558498 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-cffa694c-1b87-493e-8ed9-7ff4996bcfb5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:52.559218 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-cffa694c-1b87-493e-8ed9-7ff4996bcfb5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:52.565120 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cffa694c-1b87-493e-8ed9-7ff4996bcfb5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:52.565602 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cffa694c-1b87-493e-8ed9-7ff4996bcfb5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:52.566028 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cffa694c-1b87-493e-8ed9-7ff4996bcfb5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:52.566706 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cffa694c-1b87-493e-8ed9-7ff4996bcfb5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:52.567154 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cffa694c-1b87-493e-8ed9-7ff4996bcfb5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:52.567570 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cffa694c-1b87-493e-8ed9-7ff4996bcfb5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:52.607299 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-9b62b28e-a4b0-442d-a5bb-a8b241736a38 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:52.615430 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-9b62b28e-a4b0-442d-a5bb-a8b241736a38 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:52.616926 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-9b62b28e-a4b0-442d-a5bb-a8b241736a38 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:52.618044 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-9b62b28e-a4b0-442d-a5bb-a8b241736a38 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.149271 Sep 21 12:21:52.618609 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 80/158] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:52 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:21:52.702450 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-cffa694c-1b87-493e-8ed9-7ff4996bcfb5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:52.710313 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-cffa694c-1b87-493e-8ed9-7ff4996bcfb5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.155716 Sep 21 12:21:52.710878 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 79/159] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:52 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:21:53.476984 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-0350cb11-8a3a-473e-8112-ddc0fc9f731e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:53.477590 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-0350cb11-8a3a-473e-8112-ddc0fc9f731e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:53.484323 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0350cb11-8a3a-473e-8112-ddc0fc9f731e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:53.484832 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0350cb11-8a3a-473e-8112-ddc0fc9f731e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:53.485262 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0350cb11-8a3a-473e-8112-ddc0fc9f731e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:53.485941 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0350cb11-8a3a-473e-8112-ddc0fc9f731e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:53.486387 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0350cb11-8a3a-473e-8112-ddc0fc9f731e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:53.486833 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0350cb11-8a3a-473e-8112-ddc0fc9f731e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:53.611403 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-0350cb11-8a3a-473e-8112-ddc0fc9f731e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:53.618983 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-0350cb11-8a3a-473e-8112-ddc0fc9f731e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.145952 Sep 21 12:21:53.619556 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 81/160] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:53 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:21:53.642303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-54b4bd28-1a70-454b-af9a-d43a7d69693d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:53.642921 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-54b4bd28-1a70-454b-af9a-d43a7d69693d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:53.648869 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-54b4bd28-1a70-454b-af9a-d43a7d69693d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:53.649429 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-54b4bd28-1a70-454b-af9a-d43a7d69693d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:53.649868 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-54b4bd28-1a70-454b-af9a-d43a7d69693d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:53.650557 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-54b4bd28-1a70-454b-af9a-d43a7d69693d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:53.651017 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-54b4bd28-1a70-454b-af9a-d43a7d69693d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:53.651447 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-54b4bd28-1a70-454b-af9a-d43a7d69693d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:53.733276 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-a192550b-ea31-4431-b379-96b48b5854f5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:53.733889 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-a192550b-ea31-4431-b379-96b48b5854f5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:53.739917 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a192550b-ea31-4431-b379-96b48b5854f5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:53.740405 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a192550b-ea31-4431-b379-96b48b5854f5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:53.740842 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a192550b-ea31-4431-b379-96b48b5854f5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:53.741538 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a192550b-ea31-4431-b379-96b48b5854f5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:53.741995 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a192550b-ea31-4431-b379-96b48b5854f5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:53.742424 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a192550b-ea31-4431-b379-96b48b5854f5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:53.779726 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-54b4bd28-1a70-454b-af9a-d43a7d69693d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:53.788214 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-54b4bd28-1a70-454b-af9a-d43a7d69693d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:53.789665 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-54b4bd28-1a70-454b-af9a-d43a7d69693d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:53.790771 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-54b4bd28-1a70-454b-af9a-d43a7d69693d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.152314 Sep 21 12:21:53.791341 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 80/161] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:53 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:21:53.874131 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-a192550b-ea31-4431-b379-96b48b5854f5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:53.881957 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-a192550b-ea31-4431-b379-96b48b5854f5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.153083 Sep 21 12:21:53.882534 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 82/162] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:53 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:21:54.643089 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-1567e7d0-01b8-4932-b5c8-e8611d44c505 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:54.644357 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-1567e7d0-01b8-4932-b5c8-e8611d44c505 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:54.650885 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1567e7d0-01b8-4932-b5c8-e8611d44c505 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:54.651373 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1567e7d0-01b8-4932-b5c8-e8611d44c505 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:54.652061 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1567e7d0-01b8-4932-b5c8-e8611d44c505 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:54.652992 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1567e7d0-01b8-4932-b5c8-e8611d44c505 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:54.653520 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1567e7d0-01b8-4932-b5c8-e8611d44c505 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:54.653960 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1567e7d0-01b8-4932-b5c8-e8611d44c505 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:54.818660 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-2cad44f4-ec97-41b6-8c17-3302745d7a58 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:54.821007 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-2cad44f4-ec97-41b6-8c17-3302745d7a58 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:54.835145 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2cad44f4-ec97-41b6-8c17-3302745d7a58 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:54.835726 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2cad44f4-ec97-41b6-8c17-3302745d7a58 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:54.836409 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2cad44f4-ec97-41b6-8c17-3302745d7a58 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:54.837346 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2cad44f4-ec97-41b6-8c17-3302745d7a58 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:54.837811 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2cad44f4-ec97-41b6-8c17-3302745d7a58 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:54.838237 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2cad44f4-ec97-41b6-8c17-3302745d7a58 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:54.851376 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-1567e7d0-01b8-4932-b5c8-e8611d44c505 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:54.869976 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-1567e7d0-01b8-4932-b5c8-e8611d44c505 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.231025 Sep 21 12:21:54.871336 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 81/163] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:54 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:54.977957 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-339eeb90-571f-4dba-886d-9bf969a150c9 req-0ea376bf-948b-4972-bd46-2f22905aee8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e9ebd08-4c95-43f6-a1a4-3268532d961e", "name": "network-vif-plugged", "status": "completed", "tag": "1f39c2aa-a245-4b77-8233-20f0c6c6cb30"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:21:54.988452 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-339eeb90-571f-4dba-886d-9bf969a150c9 req-0ea376bf-948b-4972-bd46-2f22905aee8b service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:54.988641 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-339eeb90-571f-4dba-886d-9bf969a150c9 req-0ea376bf-948b-4972-bd46-2f22905aee8b service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:54.988964 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-339eeb90-571f-4dba-886d-9bf969a150c9 req-0ea376bf-948b-4972-bd46-2f22905aee8b service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:55.000245 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-339eeb90-571f-4dba-886d-9bf969a150c9 req-0ea376bf-948b-4972-bd46-2f22905aee8b service nova] Creating event network-vif-plugged:1f39c2aa-a245-4b77-8233-20f0c6c6cb30 for instance 5e9ebd08-4c95-43f6-a1a4-3268532d961e on hv-cinder-85867 Sep 21 12:21:55.005531 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-2cad44f4-ec97-41b6-8c17-3302745d7a58 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:55.005708 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-339eeb90-571f-4dba-886d-9bf969a150c9 req-0ea376bf-948b-4972-bd46-2f22905aee8b service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119569 Sep 21 12:21:55.006315 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 82/164] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:21:55.011260 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-38932841-2a8a-462d-8259-82b7cad32ab9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:55.011997 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-38932841-2a8a-462d-8259-82b7cad32ab9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:55.015101 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-2cad44f4-ec97-41b6-8c17-3302745d7a58 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:55.016570 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-2cad44f4-ec97-41b6-8c17-3302745d7a58 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:55.017682 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-2cad44f4-ec97-41b6-8c17-3302745d7a58 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.205580 Sep 21 12:21:55.018233 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 83/165] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:54 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:21:55.018828 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-38932841-2a8a-462d-8259-82b7cad32ab9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:55.019319 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-38932841-2a8a-462d-8259-82b7cad32ab9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:55.019792 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-38932841-2a8a-462d-8259-82b7cad32ab9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:55.020653 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-38932841-2a8a-462d-8259-82b7cad32ab9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:55.021117 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-38932841-2a8a-462d-8259-82b7cad32ab9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:55.021551 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-38932841-2a8a-462d-8259-82b7cad32ab9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:55.177626 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-38932841-2a8a-462d-8259-82b7cad32ab9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:55.185221 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-38932841-2a8a-462d-8259-82b7cad32ab9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.177817 Sep 21 12:21:55.186134 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 83/166] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:55 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:55.913395 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-6cb889f9-73a5-40af-b3c8-22b9dc71565c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:55.914004 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-6cb889f9-73a5-40af-b3c8-22b9dc71565c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:55.919931 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6cb889f9-73a5-40af-b3c8-22b9dc71565c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:55.920413 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6cb889f9-73a5-40af-b3c8-22b9dc71565c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:55.920846 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6cb889f9-73a5-40af-b3c8-22b9dc71565c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:55.921529 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6cb889f9-73a5-40af-b3c8-22b9dc71565c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:55.921982 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6cb889f9-73a5-40af-b3c8-22b9dc71565c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:55.922404 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6cb889f9-73a5-40af-b3c8-22b9dc71565c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:56.043463 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-2044a463-e884-48f1-8525-80afeb28a88b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:56.044267 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-2044a463-e884-48f1-8525-80afeb28a88b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:56.050271 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-6cb889f9-73a5-40af-b3c8-22b9dc71565c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:56.050851 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2044a463-e884-48f1-8525-80afeb28a88b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:56.051340 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2044a463-e884-48f1-8525-80afeb28a88b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:56.051788 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2044a463-e884-48f1-8525-80afeb28a88b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:56.052496 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2044a463-e884-48f1-8525-80afeb28a88b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:56.052976 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2044a463-e884-48f1-8525-80afeb28a88b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:56.053403 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2044a463-e884-48f1-8525-80afeb28a88b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:56.059538 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-6cb889f9-73a5-40af-b3c8-22b9dc71565c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.150049 Sep 21 12:21:56.060158 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 84/167] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:55 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:56.203518 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-2044a463-e884-48f1-8525-80afeb28a88b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:56.211474 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-89b8ef95-8abe-4790-97a2-e8fdee3d9efb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:56.212366 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-89b8ef95-8abe-4790-97a2-e8fdee3d9efb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:56.214404 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-2044a463-e884-48f1-8525-80afeb28a88b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:56.216296 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-2044a463-e884-48f1-8525-80afeb28a88b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:56.217822 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-2044a463-e884-48f1-8525-80afeb28a88b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.178312 Sep 21 12:21:56.221205 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-89b8ef95-8abe-4790-97a2-e8fdee3d9efb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:56.222382 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 84/168] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:56 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:21:56.222790 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-89b8ef95-8abe-4790-97a2-e8fdee3d9efb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:56.223394 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-89b8ef95-8abe-4790-97a2-e8fdee3d9efb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:56.224372 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-89b8ef95-8abe-4790-97a2-e8fdee3d9efb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:56.224954 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-89b8ef95-8abe-4790-97a2-e8fdee3d9efb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:56.225555 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-89b8ef95-8abe-4790-97a2-e8fdee3d9efb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:56.376004 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-89b8ef95-8abe-4790-97a2-e8fdee3d9efb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:56.384752 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-89b8ef95-8abe-4790-97a2-e8fdee3d9efb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.179681 Sep 21 12:21:56.385481 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 85/169] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:56 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:57.022852 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-2efa8e91-98ce-465e-aa5c-a6f255f53ba0 req-3c344fff-087a-45bc-ad0b-4eafebe892d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b11d666e-1c68-4889-b80e-a66aa10e05e9", "name": "network-vif-plugged", "status": "completed", "tag": "9b27a8b0-6e14-43db-b7d2-00fb7465cce0"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:21:57.033388 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-2efa8e91-98ce-465e-aa5c-a6f255f53ba0 req-3c344fff-087a-45bc-ad0b-4eafebe892d6 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:57.033879 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-2efa8e91-98ce-465e-aa5c-a6f255f53ba0 req-3c344fff-087a-45bc-ad0b-4eafebe892d6 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:57.034358 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-2efa8e91-98ce-465e-aa5c-a6f255f53ba0 req-3c344fff-087a-45bc-ad0b-4eafebe892d6 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:57.046755 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-2efa8e91-98ce-465e-aa5c-a6f255f53ba0 req-3c344fff-087a-45bc-ad0b-4eafebe892d6 service nova] Creating event network-vif-plugged:9b27a8b0-6e14-43db-b7d2-00fb7465cce0 for instance b11d666e-1c68-4889-b80e-a66aa10e05e9 on hv-cinder-85867 Sep 21 12:21:57.051850 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-2efa8e91-98ce-465e-aa5c-a6f255f53ba0 req-3c344fff-087a-45bc-ad0b-4eafebe892d6 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032616 Sep 21 12:21:57.052585 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 85/170] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 12:21:57.083983 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-f2562efb-1378-40b7-b001-ed2a3794fcad tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:57.084591 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-f2562efb-1378-40b7-b001-ed2a3794fcad tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:57.090604 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f2562efb-1378-40b7-b001-ed2a3794fcad tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:57.091082 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f2562efb-1378-40b7-b001-ed2a3794fcad tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:57.091512 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f2562efb-1378-40b7-b001-ed2a3794fcad tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:57.092790 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f2562efb-1378-40b7-b001-ed2a3794fcad tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:57.093235 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f2562efb-1378-40b7-b001-ed2a3794fcad tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:57.093656 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f2562efb-1378-40b7-b001-ed2a3794fcad tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:57.236211 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-f2562efb-1378-40b7-b001-ed2a3794fcad tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:57.241387 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=100 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:57.245149 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-0360e9bc-2a12-4fbf-b89c-732308102a44 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:57.245986 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-0360e9bc-2a12-4fbf-b89c-732308102a44 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:57.246918 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-f2562efb-1378-40b7-b001-ed2a3794fcad tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.166948 Sep 21 12:21:57.247818 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 86/171] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:57 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:57.266646 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0360e9bc-2a12-4fbf-b89c-732308102a44 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:57.267144 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0360e9bc-2a12-4fbf-b89c-732308102a44 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:57.267573 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0360e9bc-2a12-4fbf-b89c-732308102a44 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:57.268314 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0360e9bc-2a12-4fbf-b89c-732308102a44 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:57.268827 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0360e9bc-2a12-4fbf-b89c-732308102a44 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:57.269364 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0360e9bc-2a12-4fbf-b89c-732308102a44 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:57.409277 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-30b154eb-93ea-4ec0-8700-2d9d4df1907b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:57.426609 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-30b154eb-93ea-4ec0-8700-2d9d4df1907b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:57.439026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-30b154eb-93ea-4ec0-8700-2d9d4df1907b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:57.439531 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-30b154eb-93ea-4ec0-8700-2d9d4df1907b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:57.448104 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-30b154eb-93ea-4ec0-8700-2d9d4df1907b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:57.450299 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-30b154eb-93ea-4ec0-8700-2d9d4df1907b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:57.450987 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-30b154eb-93ea-4ec0-8700-2d9d4df1907b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:57.452371 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-30b154eb-93ea-4ec0-8700-2d9d4df1907b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:57.492167 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-0360e9bc-2a12-4fbf-b89c-732308102a44 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:57.499042 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=100 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:57.510529 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-0360e9bc-2a12-4fbf-b89c-732308102a44 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:57.512295 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-0360e9bc-2a12-4fbf-b89c-732308102a44 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:57.514241 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-0360e9bc-2a12-4fbf-b89c-732308102a44 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.273380 Sep 21 12:21:57.515348 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 86/172] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:57 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:21:57.674633 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-30b154eb-93ea-4ec0-8700-2d9d4df1907b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:57.690062 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-30b154eb-93ea-4ec0-8700-2d9d4df1907b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.285707 Sep 21 12:21:57.690811 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 87/173] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:57 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:21:58.268911 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-1a6a840a-298c-42a2-acfb-6168d9a78300 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:58.270359 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-1a6a840a-298c-42a2-acfb-6168d9a78300 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:58.278296 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1a6a840a-298c-42a2-acfb-6168d9a78300 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:58.279007 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1a6a840a-298c-42a2-acfb-6168d9a78300 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:58.279452 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1a6a840a-298c-42a2-acfb-6168d9a78300 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:58.280372 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1a6a840a-298c-42a2-acfb-6168d9a78300 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:58.280717 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1a6a840a-298c-42a2-acfb-6168d9a78300 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:58.281155 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1a6a840a-298c-42a2-acfb-6168d9a78300 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:58.416561 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-1a6a840a-298c-42a2-acfb-6168d9a78300 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:58.425146 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-1a6a840a-298c-42a2-acfb-6168d9a78300 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.160229 Sep 21 12:21:58.425742 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 87/174] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:58 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:58.538792 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-9757bcdb-247f-47e4-adf5-4572b2892e18 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:58.539308 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-9757bcdb-247f-47e4-adf5-4572b2892e18 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:58.551518 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9757bcdb-247f-47e4-adf5-4572b2892e18 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:58.552047 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9757bcdb-247f-47e4-adf5-4572b2892e18 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:58.552485 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9757bcdb-247f-47e4-adf5-4572b2892e18 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:58.553228 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9757bcdb-247f-47e4-adf5-4572b2892e18 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:58.553667 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9757bcdb-247f-47e4-adf5-4572b2892e18 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:58.554096 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9757bcdb-247f-47e4-adf5-4572b2892e18 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:58.688618 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-9757bcdb-247f-47e4-adf5-4572b2892e18 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:58.696905 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-9757bcdb-247f-47e4-adf5-4572b2892e18 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:58.698365 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-9757bcdb-247f-47e4-adf5-4572b2892e18 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:58.699469 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-9757bcdb-247f-47e4-adf5-4572b2892e18 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.164602 Sep 21 12:21:58.700284 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 88/175] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:58 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:21:58.716134 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-266bde95-f643-46bc-a0d0-aebd1ed96a2e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:58.716774 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-266bde95-f643-46bc-a0d0-aebd1ed96a2e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:58.722983 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-266bde95-f643-46bc-a0d0-aebd1ed96a2e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:58.723465 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-266bde95-f643-46bc-a0d0-aebd1ed96a2e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:58.723935 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-266bde95-f643-46bc-a0d0-aebd1ed96a2e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:58.724626 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-266bde95-f643-46bc-a0d0-aebd1ed96a2e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:58.725082 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-266bde95-f643-46bc-a0d0-aebd1ed96a2e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:58.725508 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-266bde95-f643-46bc-a0d0-aebd1ed96a2e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:58.857057 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-266bde95-f643-46bc-a0d0-aebd1ed96a2e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:58.864987 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-266bde95-f643-46bc-a0d0-aebd1ed96a2e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.152691 Sep 21 12:21:58.865571 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 88/176] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:58 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:59.448213 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-4299656f-d596-4eae-8451-56259980ddf3 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:59.448830 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-4299656f-d596-4eae-8451-56259980ddf3 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:59.454746 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4299656f-d596-4eae-8451-56259980ddf3 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:59.455440 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4299656f-d596-4eae-8451-56259980ddf3 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:59.456257 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4299656f-d596-4eae-8451-56259980ddf3 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:59.457479 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4299656f-d596-4eae-8451-56259980ddf3 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:59.458507 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4299656f-d596-4eae-8451-56259980ddf3 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:59.458956 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4299656f-d596-4eae-8451-56259980ddf3 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:59.604245 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-4299656f-d596-4eae-8451-56259980ddf3 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:59.612709 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-4299656f-d596-4eae-8451-56259980ddf3 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.168270 Sep 21 12:21:59.613381 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 89/177] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:59 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:21:59.726284 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-6161ca26-c409-4c10-a132-dd28b04a3204 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:59.726911 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-6161ca26-c409-4c10-a132-dd28b04a3204 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:59.732999 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6161ca26-c409-4c10-a132-dd28b04a3204 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:59.733491 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6161ca26-c409-4c10-a132-dd28b04a3204 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:59.733936 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6161ca26-c409-4c10-a132-dd28b04a3204 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:59.734633 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6161ca26-c409-4c10-a132-dd28b04a3204 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:59.735097 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6161ca26-c409-4c10-a132-dd28b04a3204 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:59.735541 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6161ca26-c409-4c10-a132-dd28b04a3204 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:59.879881 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-6161ca26-c409-4c10-a132-dd28b04a3204 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:59.888445 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-6161ca26-c409-4c10-a132-dd28b04a3204 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:59.889373 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-d3229755-12ef-4c47-9427-f912fd6f6582 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:21:59.889990 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-d3229755-12ef-4c47-9427-f912fd6f6582 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:21:59.890452 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-6161ca26-c409-4c10-a132-dd28b04a3204 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:21:59.891568 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-6161ca26-c409-4c10-a132-dd28b04a3204 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.169136 Sep 21 12:21:59.892165 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 89/178] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:21:59 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:21:59.897517 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d3229755-12ef-4c47-9427-f912fd6f6582 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:59.898442 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d3229755-12ef-4c47-9427-f912fd6f6582 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:59.898990 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d3229755-12ef-4c47-9427-f912fd6f6582 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:21:59.899580 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d3229755-12ef-4c47-9427-f912fd6f6582 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:21:59.900107 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d3229755-12ef-4c47-9427-f912fd6f6582 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:21:59.900569 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d3229755-12ef-4c47-9427-f912fd6f6582 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:00.045690 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-d3229755-12ef-4c47-9427-f912fd6f6582 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:00.053622 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-d3229755-12ef-4c47-9427-f912fd6f6582 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.168419 Sep 21 12:22:00.054466 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 90/179] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:21:59 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:22:00.634952 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-2c0ba1ac-db13-413d-a4b8-277efc386c90 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:00.635565 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-2c0ba1ac-db13-413d-a4b8-277efc386c90 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:00.642459 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2c0ba1ac-db13-413d-a4b8-277efc386c90 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:00.643004 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2c0ba1ac-db13-413d-a4b8-277efc386c90 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:00.643358 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2c0ba1ac-db13-413d-a4b8-277efc386c90 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:00.644148 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2c0ba1ac-db13-413d-a4b8-277efc386c90 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:00.644599 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2c0ba1ac-db13-413d-a4b8-277efc386c90 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:00.645019 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2c0ba1ac-db13-413d-a4b8-277efc386c90 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:00.797679 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-2c0ba1ac-db13-413d-a4b8-277efc386c90 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:00.811117 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-2c0ba1ac-db13-413d-a4b8-277efc386c90 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.180076 Sep 21 12:22:00.812006 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 90/180] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:00 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:00.919599 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-10240c2f-d3c0-4c66-b351-67557a83536d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:00.920253 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-10240c2f-d3c0-4c66-b351-67557a83536d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:00.926440 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-10240c2f-d3c0-4c66-b351-67557a83536d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:00.926921 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-10240c2f-d3c0-4c66-b351-67557a83536d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:00.927723 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-10240c2f-d3c0-4c66-b351-67557a83536d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:00.928439 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-10240c2f-d3c0-4c66-b351-67557a83536d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:00.928891 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-10240c2f-d3c0-4c66-b351-67557a83536d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:00.929307 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-10240c2f-d3c0-4c66-b351-67557a83536d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:01.058797 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-10240c2f-d3c0-4c66-b351-67557a83536d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:01.067357 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-10240c2f-d3c0-4c66-b351-67557a83536d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:01.068848 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-10240c2f-d3c0-4c66-b351-67557a83536d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:01.069961 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-10240c2f-d3c0-4c66-b351-67557a83536d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.155746 Sep 21 12:22:01.070526 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 91/181] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:22:00 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:22:01.078439 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-1020d9b7-9b29-4800-bc8b-b561bde2e7ac tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:01.079169 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-1020d9b7-9b29-4800-bc8b-b561bde2e7ac tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:01.085434 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1020d9b7-9b29-4800-bc8b-b561bde2e7ac tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:01.085999 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1020d9b7-9b29-4800-bc8b-b561bde2e7ac tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:01.086532 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1020d9b7-9b29-4800-bc8b-b561bde2e7ac tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:01.087300 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1020d9b7-9b29-4800-bc8b-b561bde2e7ac tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:01.087860 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1020d9b7-9b29-4800-bc8b-b561bde2e7ac tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:01.088459 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1020d9b7-9b29-4800-bc8b-b561bde2e7ac tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:01.220844 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-1020d9b7-9b29-4800-bc8b-b561bde2e7ac tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:01.229026 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-1020d9b7-9b29-4800-bc8b-b561bde2e7ac tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.154999 Sep 21 12:22:01.229616 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 91/182] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:01 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:01.836280 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-a259d638-1214-484e-afdb-a662f7821e8b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:01.836881 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-a259d638-1214-484e-afdb-a662f7821e8b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:01.843442 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a259d638-1214-484e-afdb-a662f7821e8b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:01.843941 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a259d638-1214-484e-afdb-a662f7821e8b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:01.844366 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a259d638-1214-484e-afdb-a662f7821e8b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:01.845036 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a259d638-1214-484e-afdb-a662f7821e8b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:01.845479 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a259d638-1214-484e-afdb-a662f7821e8b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:01.845898 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a259d638-1214-484e-afdb-a662f7821e8b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:01.977121 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-a259d638-1214-484e-afdb-a662f7821e8b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:01.985320 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-a259d638-1214-484e-afdb-a662f7821e8b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.153090 Sep 21 12:22:01.985890 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 92/183] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:01 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:02.096987 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-cf446c14-73bf-4fda-aa4d-bd4b9afec351 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:02.097623 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-cf446c14-73bf-4fda-aa4d-bd4b9afec351 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:02.104045 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cf446c14-73bf-4fda-aa4d-bd4b9afec351 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:02.104539 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cf446c14-73bf-4fda-aa4d-bd4b9afec351 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:02.105923 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cf446c14-73bf-4fda-aa4d-bd4b9afec351 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:02.105923 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cf446c14-73bf-4fda-aa4d-bd4b9afec351 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:02.106712 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cf446c14-73bf-4fda-aa4d-bd4b9afec351 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:02.106712 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cf446c14-73bf-4fda-aa4d-bd4b9afec351 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:02.252625 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-106db3dd-5424-469f-9965-62c13c8d9903 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:02.254013 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-106db3dd-5424-469f-9965-62c13c8d9903 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:02.262857 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-106db3dd-5424-469f-9965-62c13c8d9903 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:02.263360 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-106db3dd-5424-469f-9965-62c13c8d9903 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:02.264352 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-106db3dd-5424-469f-9965-62c13c8d9903 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:02.269218 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-106db3dd-5424-469f-9965-62c13c8d9903 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:02.270368 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-106db3dd-5424-469f-9965-62c13c8d9903 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:02.271241 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-106db3dd-5424-469f-9965-62c13c8d9903 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:02.301295 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-cf446c14-73bf-4fda-aa4d-bd4b9afec351 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:02.310003 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-cf446c14-73bf-4fda-aa4d-bd4b9afec351 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:02.311627 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-cf446c14-73bf-4fda-aa4d-bd4b9afec351 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:02.313003 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-cf446c14-73bf-4fda-aa4d-bd4b9afec351 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.221272 Sep 21 12:22:02.313801 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 92/184] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:22:02 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:22:02.406121 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-106db3dd-5424-469f-9965-62c13c8d9903 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:02.413971 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-106db3dd-5424-469f-9965-62c13c8d9903 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.165941 Sep 21 12:22:02.414569 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 93/185] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:02 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:22:03.007395 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-27c8b895-4daa-4894-b8db-12c74ae34ee1 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:03.008045 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-27c8b895-4daa-4894-b8db-12c74ae34ee1 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:03.014296 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-27c8b895-4daa-4894-b8db-12c74ae34ee1 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:03.014780 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-27c8b895-4daa-4894-b8db-12c74ae34ee1 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:03.015220 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-27c8b895-4daa-4894-b8db-12c74ae34ee1 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:03.015954 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-27c8b895-4daa-4894-b8db-12c74ae34ee1 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:03.016413 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-27c8b895-4daa-4894-b8db-12c74ae34ee1 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:03.016844 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-27c8b895-4daa-4894-b8db-12c74ae34ee1 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:03.144897 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-27c8b895-4daa-4894-b8db-12c74ae34ee1 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:03.152499 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-27c8b895-4daa-4894-b8db-12c74ae34ee1 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.148887 Sep 21 12:22:03.153076 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 93/186] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:03 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:03.338554 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-3488ea2e-5c32-4c34-93fb-e6526c552d8f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:03.339399 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-3488ea2e-5c32-4c34-93fb-e6526c552d8f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:03.345743 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3488ea2e-5c32-4c34-93fb-e6526c552d8f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:03.346219 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3488ea2e-5c32-4c34-93fb-e6526c552d8f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:03.346651 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3488ea2e-5c32-4c34-93fb-e6526c552d8f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:03.347340 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3488ea2e-5c32-4c34-93fb-e6526c552d8f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:03.347812 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3488ea2e-5c32-4c34-93fb-e6526c552d8f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:03.348243 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3488ea2e-5c32-4c34-93fb-e6526c552d8f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:03.437127 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-fd5d4b91-8cd0-44b9-bdfb-b65f0d716fc4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:03.437770 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-fd5d4b91-8cd0-44b9-bdfb-b65f0d716fc4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:03.443591 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fd5d4b91-8cd0-44b9-bdfb-b65f0d716fc4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:03.444114 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fd5d4b91-8cd0-44b9-bdfb-b65f0d716fc4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:03.444553 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fd5d4b91-8cd0-44b9-bdfb-b65f0d716fc4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:03.445228 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fd5d4b91-8cd0-44b9-bdfb-b65f0d716fc4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:03.445829 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fd5d4b91-8cd0-44b9-bdfb-b65f0d716fc4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:03.446106 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fd5d4b91-8cd0-44b9-bdfb-b65f0d716fc4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:03.511595 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-3488ea2e-5c32-4c34-93fb-e6526c552d8f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:03.521924 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-3488ea2e-5c32-4c34-93fb-e6526c552d8f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:03.523392 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-3488ea2e-5c32-4c34-93fb-e6526c552d8f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:03.527484 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-3488ea2e-5c32-4c34-93fb-e6526c552d8f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.192645 Sep 21 12:22:03.528603 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 94/187] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:22:03 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:22:03.602937 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-fd5d4b91-8cd0-44b9-bdfb-b65f0d716fc4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:03.610716 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-fd5d4b91-8cd0-44b9-bdfb-b65f0d716fc4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.177431 Sep 21 12:22:03.611287 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 94/188] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:03 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:04.176060 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-273b81da-3d61-476f-ad24-ee111cf28d63 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:04.176682 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-273b81da-3d61-476f-ad24-ee111cf28d63 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:04.182627 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-273b81da-3d61-476f-ad24-ee111cf28d63 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:04.183121 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-273b81da-3d61-476f-ad24-ee111cf28d63 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:04.183558 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-273b81da-3d61-476f-ad24-ee111cf28d63 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:04.184289 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-273b81da-3d61-476f-ad24-ee111cf28d63 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:04.184748 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-273b81da-3d61-476f-ad24-ee111cf28d63 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:04.185168 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-273b81da-3d61-476f-ad24-ee111cf28d63 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:04.332874 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-273b81da-3d61-476f-ad24-ee111cf28d63 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:04.343836 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-273b81da-3d61-476f-ad24-ee111cf28d63 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.171924 Sep 21 12:22:04.355817 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 95/189] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:04 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:04.557927 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-da9a89b0-9d87-48cb-8fd5-6ab504d6bb8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:04.558749 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-da9a89b0-9d87-48cb-8fd5-6ab504d6bb8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:04.565494 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-da9a89b0-9d87-48cb-8fd5-6ab504d6bb8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:04.565987 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-da9a89b0-9d87-48cb-8fd5-6ab504d6bb8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:04.566426 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-da9a89b0-9d87-48cb-8fd5-6ab504d6bb8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:04.567322 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-da9a89b0-9d87-48cb-8fd5-6ab504d6bb8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:04.567852 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-da9a89b0-9d87-48cb-8fd5-6ab504d6bb8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:04.568469 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-da9a89b0-9d87-48cb-8fd5-6ab504d6bb8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:04.633040 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-e617538c-ead7-4bea-9d12-fd584b0b6ba9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:04.634063 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-e617538c-ead7-4bea-9d12-fd584b0b6ba9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:04.640315 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e617538c-ead7-4bea-9d12-fd584b0b6ba9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:04.640790 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e617538c-ead7-4bea-9d12-fd584b0b6ba9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:04.641463 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e617538c-ead7-4bea-9d12-fd584b0b6ba9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:04.642168 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e617538c-ead7-4bea-9d12-fd584b0b6ba9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:04.642617 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e617538c-ead7-4bea-9d12-fd584b0b6ba9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:04.643037 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e617538c-ead7-4bea-9d12-fd584b0b6ba9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:04.708415 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-da9a89b0-9d87-48cb-8fd5-6ab504d6bb8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:04.717091 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-da9a89b0-9d87-48cb-8fd5-6ab504d6bb8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:04.718834 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-da9a89b0-9d87-48cb-8fd5-6ab504d6bb8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:04.719995 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-da9a89b0-9d87-48cb-8fd5-6ab504d6bb8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.166409 Sep 21 12:22:04.729777 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 95/190] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:22:04 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:22:04.843500 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-e617538c-ead7-4bea-9d12-fd584b0b6ba9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:04.851539 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-e617538c-ead7-4bea-9d12-fd584b0b6ba9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.222400 Sep 21 12:22:04.852413 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 96/191] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:04 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:05.367020 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-7929f65b-64b1-42aa-a27f-2cd3b7fa2748 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:05.367919 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-7929f65b-64b1-42aa-a27f-2cd3b7fa2748 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:05.374294 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7929f65b-64b1-42aa-a27f-2cd3b7fa2748 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:05.374974 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7929f65b-64b1-42aa-a27f-2cd3b7fa2748 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:05.375414 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7929f65b-64b1-42aa-a27f-2cd3b7fa2748 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:05.376152 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7929f65b-64b1-42aa-a27f-2cd3b7fa2748 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:05.376618 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7929f65b-64b1-42aa-a27f-2cd3b7fa2748 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:05.377052 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7929f65b-64b1-42aa-a27f-2cd3b7fa2748 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:05.514036 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-7929f65b-64b1-42aa-a27f-2cd3b7fa2748 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:05.521597 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-7929f65b-64b1-42aa-a27f-2cd3b7fa2748 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.158909 Sep 21 12:22:05.522164 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 96/192] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:05 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:05.746525 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-8f1824df-edea-41e1-9478-5325f2fe3988 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:05.749571 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-8f1824df-edea-41e1-9478-5325f2fe3988 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:05.756446 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8f1824df-edea-41e1-9478-5325f2fe3988 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:05.756937 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8f1824df-edea-41e1-9478-5325f2fe3988 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:05.757375 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8f1824df-edea-41e1-9478-5325f2fe3988 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:05.758341 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8f1824df-edea-41e1-9478-5325f2fe3988 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:05.758805 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8f1824df-edea-41e1-9478-5325f2fe3988 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:05.759231 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8f1824df-edea-41e1-9478-5325f2fe3988 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:05.875154 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-9e6bd5f8-3f60-486d-a693-ee8273508e3e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:05.875795 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-9e6bd5f8-3f60-486d-a693-ee8273508e3e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:05.882059 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9e6bd5f8-3f60-486d-a693-ee8273508e3e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:05.882552 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9e6bd5f8-3f60-486d-a693-ee8273508e3e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:05.882990 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9e6bd5f8-3f60-486d-a693-ee8273508e3e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:05.883691 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9e6bd5f8-3f60-486d-a693-ee8273508e3e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:05.884194 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9e6bd5f8-3f60-486d-a693-ee8273508e3e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:05.884616 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9e6bd5f8-3f60-486d-a693-ee8273508e3e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:05.899640 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-8f1824df-edea-41e1-9478-5325f2fe3988 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:05.915667 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-8f1824df-edea-41e1-9478-5325f2fe3988 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:05.919944 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-8f1824df-edea-41e1-9478-5325f2fe3988 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:05.921259 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-8f1824df-edea-41e1-9478-5325f2fe3988 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.178908 Sep 21 12:22:05.922013 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 97/193] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:22:05 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:22:06.022816 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-9e6bd5f8-3f60-486d-a693-ee8273508e3e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:06.031174 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-9e6bd5f8-3f60-486d-a693-ee8273508e3e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.160629 Sep 21 12:22:06.031852 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 97/194] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:05 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:22:06.545608 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-cfb67d04-25c0-4c3c-a25c-4179850e8c4e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:06.546208 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-cfb67d04-25c0-4c3c-a25c-4179850e8c4e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:06.552467 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-cfb67d04-25c0-4c3c-a25c-4179850e8c4e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:06.553072 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-cfb67d04-25c0-4c3c-a25c-4179850e8c4e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:06.553584 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-cfb67d04-25c0-4c3c-a25c-4179850e8c4e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:06.554516 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-cfb67d04-25c0-4c3c-a25c-4179850e8c4e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:06.555295 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-cfb67d04-25c0-4c3c-a25c-4179850e8c4e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:06.555819 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-cfb67d04-25c0-4c3c-a25c-4179850e8c4e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:06.689609 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-cfb67d04-25c0-4c3c-a25c-4179850e8c4e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:06.697316 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-cfb67d04-25c0-4c3c-a25c-4179850e8c4e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.155976 Sep 21 12:22:06.697897 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 98/195] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:06 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:06.950103 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-7b7747c5-09d4-4ff0-9aff-82b869bd4b14 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:06.950802 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-7b7747c5-09d4-4ff0-9aff-82b869bd4b14 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:06.957487 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7b7747c5-09d4-4ff0-9aff-82b869bd4b14 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:06.957982 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7b7747c5-09d4-4ff0-9aff-82b869bd4b14 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:06.958513 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7b7747c5-09d4-4ff0-9aff-82b869bd4b14 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:06.966191 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7b7747c5-09d4-4ff0-9aff-82b869bd4b14 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:06.967215 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7b7747c5-09d4-4ff0-9aff-82b869bd4b14 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:06.967671 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7b7747c5-09d4-4ff0-9aff-82b869bd4b14 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:07.054479 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-a5b9420d-7b3b-484d-ac70-f34bf06812bf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:07.055088 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-a5b9420d-7b3b-484d-ac70-f34bf06812bf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:07.061736 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a5b9420d-7b3b-484d-ac70-f34bf06812bf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:07.062358 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a5b9420d-7b3b-484d-ac70-f34bf06812bf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:07.062799 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a5b9420d-7b3b-484d-ac70-f34bf06812bf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:07.063518 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a5b9420d-7b3b-484d-ac70-f34bf06812bf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:07.063967 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a5b9420d-7b3b-484d-ac70-f34bf06812bf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:07.064389 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a5b9420d-7b3b-484d-ac70-f34bf06812bf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:07.123250 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-7b7747c5-09d4-4ff0-9aff-82b869bd4b14 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:07.132139 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-7b7747c5-09d4-4ff0-9aff-82b869bd4b14 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:07.134621 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-7b7747c5-09d4-4ff0-9aff-82b869bd4b14 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:07.135814 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-7b7747c5-09d4-4ff0-9aff-82b869bd4b14 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.191548 Sep 21 12:22:07.136541 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 98/196] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:22:06 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:22:07.230069 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-a5b9420d-7b3b-484d-ac70-f34bf06812bf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:07.237843 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-a5b9420d-7b3b-484d-ac70-f34bf06812bf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.187121 Sep 21 12:22:07.238416 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 99/197] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:07 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:22:07.720091 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-e57b219f-5fa1-4d10-aa34-cf8aaa59e2c9 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:07.720707 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-e57b219f-5fa1-4d10-aa34-cf8aaa59e2c9 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:07.726486 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e57b219f-5fa1-4d10-aa34-cf8aaa59e2c9 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:07.726967 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e57b219f-5fa1-4d10-aa34-cf8aaa59e2c9 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:07.727399 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e57b219f-5fa1-4d10-aa34-cf8aaa59e2c9 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:07.728192 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e57b219f-5fa1-4d10-aa34-cf8aaa59e2c9 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:07.728651 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e57b219f-5fa1-4d10-aa34-cf8aaa59e2c9 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:07.729078 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e57b219f-5fa1-4d10-aa34-cf8aaa59e2c9 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:07.853737 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-e57b219f-5fa1-4d10-aa34-cf8aaa59e2c9 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:07.861226 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-e57b219f-5fa1-4d10-aa34-cf8aaa59e2c9 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.144944 Sep 21 12:22:07.861791 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 99/198] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:07 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:08.164010 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-67116ebe-efbb-4b9a-b868-12c1ec9ad76f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:08.164649 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-67116ebe-efbb-4b9a-b868-12c1ec9ad76f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:08.171026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-67116ebe-efbb-4b9a-b868-12c1ec9ad76f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:08.171520 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-67116ebe-efbb-4b9a-b868-12c1ec9ad76f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:08.171992 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-67116ebe-efbb-4b9a-b868-12c1ec9ad76f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:08.172681 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-67116ebe-efbb-4b9a-b868-12c1ec9ad76f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:08.173135 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-67116ebe-efbb-4b9a-b868-12c1ec9ad76f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:08.173561 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-67116ebe-efbb-4b9a-b868-12c1ec9ad76f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:08.260386 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-83dc6b30-e79e-4968-a2c6-fc50e19812bc tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:08.261002 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-83dc6b30-e79e-4968-a2c6-fc50e19812bc tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:08.266980 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-83dc6b30-e79e-4968-a2c6-fc50e19812bc tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:08.267468 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-83dc6b30-e79e-4968-a2c6-fc50e19812bc tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:08.267942 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-83dc6b30-e79e-4968-a2c6-fc50e19812bc tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:08.268682 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-83dc6b30-e79e-4968-a2c6-fc50e19812bc tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:08.269139 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-83dc6b30-e79e-4968-a2c6-fc50e19812bc tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:08.269561 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-83dc6b30-e79e-4968-a2c6-fc50e19812bc tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:08.315392 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-67116ebe-efbb-4b9a-b868-12c1ec9ad76f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:08.323450 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-67116ebe-efbb-4b9a-b868-12c1ec9ad76f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:08.324929 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-67116ebe-efbb-4b9a-b868-12c1ec9ad76f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:08.326064 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-67116ebe-efbb-4b9a-b868-12c1ec9ad76f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.165998 Sep 21 12:22:08.326630 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 100/199] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:22:08 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:22:08.403587 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-83dc6b30-e79e-4968-a2c6-fc50e19812bc tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:08.411665 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-83dc6b30-e79e-4968-a2c6-fc50e19812bc tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.155082 Sep 21 12:22:08.412346 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 100/200] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:08 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:22:08.579131 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-c7ac373a-4443-49a0-b77f-7199604b503a req-de9da784-6a8a-40bd-b719-a1a117315b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee010d1f-46d4-487e-a93e-66c5e2ac895e", "name": "network-vif-plugged", "status": "completed", "tag": "ee7ca2d0-d70f-46f5-af82-81e48a262d02"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:22:08.589954 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-c7ac373a-4443-49a0-b77f-7199604b503a req-de9da784-6a8a-40bd-b719-a1a117315b2a service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:08.590431 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-c7ac373a-4443-49a0-b77f-7199604b503a req-de9da784-6a8a-40bd-b719-a1a117315b2a service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:08.590868 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-c7ac373a-4443-49a0-b77f-7199604b503a req-de9da784-6a8a-40bd-b719-a1a117315b2a service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:08.603952 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-c7ac373a-4443-49a0-b77f-7199604b503a req-de9da784-6a8a-40bd-b719-a1a117315b2a service nova] Creating event network-vif-plugged:ee7ca2d0-d70f-46f5-af82-81e48a262d02 for instance ee010d1f-46d4-487e-a93e-66c5e2ac895e on hv-cinder-85867 Sep 21 12:22:08.609790 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-c7ac373a-4443-49a0-b77f-7199604b503a req-de9da784-6a8a-40bd-b719-a1a117315b2a service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034314 Sep 21 12:22:08.610589 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 101/201] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:22:08.884196 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-a6b06ea7-8a94-4fdc-94c7-e544211eef3e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:08.884801 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-a6b06ea7-8a94-4fdc-94c7-e544211eef3e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:08.891268 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a6b06ea7-8a94-4fdc-94c7-e544211eef3e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:08.891744 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a6b06ea7-8a94-4fdc-94c7-e544211eef3e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:08.892220 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a6b06ea7-8a94-4fdc-94c7-e544211eef3e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:08.892895 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a6b06ea7-8a94-4fdc-94c7-e544211eef3e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:08.893334 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a6b06ea7-8a94-4fdc-94c7-e544211eef3e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:08.893751 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a6b06ea7-8a94-4fdc-94c7-e544211eef3e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:09.023169 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a6b06ea7-8a94-4fdc-94c7-e544211eef3e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:09.031416 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-a6b06ea7-8a94-4fdc-94c7-e544211eef3e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.151063 Sep 21 12:22:09.032025 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 101/202] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:08 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:09.351186 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-c2d99813-7e3f-430a-97f5-04c1bb222ed7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:09.351892 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-c2d99813-7e3f-430a-97f5-04c1bb222ed7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:09.357877 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c2d99813-7e3f-430a-97f5-04c1bb222ed7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:09.358349 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c2d99813-7e3f-430a-97f5-04c1bb222ed7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:09.358788 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c2d99813-7e3f-430a-97f5-04c1bb222ed7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:09.359460 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c2d99813-7e3f-430a-97f5-04c1bb222ed7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:09.359936 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c2d99813-7e3f-430a-97f5-04c1bb222ed7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:09.360357 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c2d99813-7e3f-430a-97f5-04c1bb222ed7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:09.436339 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-71e191ad-636d-49c9-9348-0f225bc18716 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:09.436963 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-71e191ad-636d-49c9-9348-0f225bc18716 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:09.443209 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-71e191ad-636d-49c9-9348-0f225bc18716 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:09.443693 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-71e191ad-636d-49c9-9348-0f225bc18716 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:09.444161 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-71e191ad-636d-49c9-9348-0f225bc18716 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:09.444850 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-71e191ad-636d-49c9-9348-0f225bc18716 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:09.445301 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-71e191ad-636d-49c9-9348-0f225bc18716 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:09.445723 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-71e191ad-636d-49c9-9348-0f225bc18716 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:09.491039 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-c2d99813-7e3f-430a-97f5-04c1bb222ed7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:09.500325 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-c2d99813-7e3f-430a-97f5-04c1bb222ed7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:09.501784 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-c2d99813-7e3f-430a-97f5-04c1bb222ed7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:09.502901 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-c2d99813-7e3f-430a-97f5-04c1bb222ed7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.156021 Sep 21 12:22:09.503673 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 102/203] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:22:09 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:22:09.587443 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-71e191ad-636d-49c9-9348-0f225bc18716 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:09.595166 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-71e191ad-636d-49c9-9348-0f225bc18716 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.164546 Sep 21 12:22:09.595729 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 102/204] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:09 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:10.053736 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-bd94175b-03dd-4f54-9311-0e7fede8bbf8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:10.054268 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-bd94175b-03dd-4f54-9311-0e7fede8bbf8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:10.060596 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bd94175b-03dd-4f54-9311-0e7fede8bbf8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:10.061467 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bd94175b-03dd-4f54-9311-0e7fede8bbf8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:10.061467 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bd94175b-03dd-4f54-9311-0e7fede8bbf8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:10.062158 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bd94175b-03dd-4f54-9311-0e7fede8bbf8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:10.063099 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bd94175b-03dd-4f54-9311-0e7fede8bbf8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:10.063220 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bd94175b-03dd-4f54-9311-0e7fede8bbf8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:10.192025 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-bd94175b-03dd-4f54-9311-0e7fede8bbf8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:10.199723 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-bd94175b-03dd-4f54-9311-0e7fede8bbf8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.149990 Sep 21 12:22:10.200334 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 103/205] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:10 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:10.528044 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-5e5fc525-cae5-4ca7-b07e-a6a886d11f2f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:10.528654 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-5e5fc525-cae5-4ca7-b07e-a6a886d11f2f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:10.535246 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5e5fc525-cae5-4ca7-b07e-a6a886d11f2f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:10.535730 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5e5fc525-cae5-4ca7-b07e-a6a886d11f2f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:10.536199 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5e5fc525-cae5-4ca7-b07e-a6a886d11f2f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:10.536889 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5e5fc525-cae5-4ca7-b07e-a6a886d11f2f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:10.537376 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5e5fc525-cae5-4ca7-b07e-a6a886d11f2f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:10.537836 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5e5fc525-cae5-4ca7-b07e-a6a886d11f2f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:10.555465 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=100 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:10.618918 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-7cd22b16-4ed6-4076-9664-9b990c83065b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:10.619303 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-7cd22b16-4ed6-4076-9664-9b990c83065b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:10.626056 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7cd22b16-4ed6-4076-9664-9b990c83065b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:10.626646 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7cd22b16-4ed6-4076-9664-9b990c83065b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:10.627081 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7cd22b16-4ed6-4076-9664-9b990c83065b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:10.627792 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7cd22b16-4ed6-4076-9664-9b990c83065b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:10.628250 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7cd22b16-4ed6-4076-9664-9b990c83065b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:10.628675 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7cd22b16-4ed6-4076-9664-9b990c83065b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:10.634154 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=100 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:10.675531 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-5e5fc525-cae5-4ca7-b07e-a6a886d11f2f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:10.683854 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-5e5fc525-cae5-4ca7-b07e-a6a886d11f2f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:10.685740 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-5e5fc525-cae5-4ca7-b07e-a6a886d11f2f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:10.686861 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-5e5fc525-cae5-4ca7-b07e-a6a886d11f2f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.162840 Sep 21 12:22:10.687421 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 103/206] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:22:10 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:22:10.775209 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-7cd22b16-4ed6-4076-9664-9b990c83065b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:10.782942 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-7cd22b16-4ed6-4076-9664-9b990c83065b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.168373 Sep 21 12:22:10.783521 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 104/207] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:10 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:22:11.222500 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-6073536f-c803-4ad0-b67d-80e7e3d896b2 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:11.223111 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-6073536f-c803-4ad0-b67d-80e7e3d896b2 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:11.229159 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6073536f-c803-4ad0-b67d-80e7e3d896b2 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:11.229645 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6073536f-c803-4ad0-b67d-80e7e3d896b2 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:11.230086 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6073536f-c803-4ad0-b67d-80e7e3d896b2 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:11.230769 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6073536f-c803-4ad0-b67d-80e7e3d896b2 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:11.231225 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6073536f-c803-4ad0-b67d-80e7e3d896b2 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:11.231652 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6073536f-c803-4ad0-b67d-80e7e3d896b2 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:11.360864 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-6073536f-c803-4ad0-b67d-80e7e3d896b2 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:11.368867 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-6073536f-c803-4ad0-b67d-80e7e3d896b2 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.150177 Sep 21 12:22:11.369442 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 104/208] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:11 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:11.712497 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-de643852-2d11-47d4-8eb2-3e2786dfa491 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:11.713191 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-de643852-2d11-47d4-8eb2-3e2786dfa491 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:11.719961 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-de643852-2d11-47d4-8eb2-3e2786dfa491 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:11.720446 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-de643852-2d11-47d4-8eb2-3e2786dfa491 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:11.720881 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-de643852-2d11-47d4-8eb2-3e2786dfa491 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:11.721579 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-de643852-2d11-47d4-8eb2-3e2786dfa491 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:11.722040 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-de643852-2d11-47d4-8eb2-3e2786dfa491 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:11.722468 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-de643852-2d11-47d4-8eb2-3e2786dfa491 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:11.806382 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-b7e0a989-931f-4b87-8380-ad90edc03bf9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:11.806996 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-b7e0a989-931f-4b87-8380-ad90edc03bf9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:11.813129 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b7e0a989-931f-4b87-8380-ad90edc03bf9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:11.813615 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b7e0a989-931f-4b87-8380-ad90edc03bf9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:11.814084 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b7e0a989-931f-4b87-8380-ad90edc03bf9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:11.814805 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b7e0a989-931f-4b87-8380-ad90edc03bf9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:11.815251 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b7e0a989-931f-4b87-8380-ad90edc03bf9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:11.815669 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b7e0a989-931f-4b87-8380-ad90edc03bf9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:11.850672 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-de643852-2d11-47d4-8eb2-3e2786dfa491 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:11.859132 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-de643852-2d11-47d4-8eb2-3e2786dfa491 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:11.860834 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-de643852-2d11-47d4-8eb2-3e2786dfa491 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:11.861936 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-de643852-2d11-47d4-8eb2-3e2786dfa491 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.153518 Sep 21 12:22:11.862496 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 105/209] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:22:11 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:22:11.958453 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-b7e0a989-931f-4b87-8380-ad90edc03bf9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:11.966010 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-b7e0a989-931f-4b87-8380-ad90edc03bf9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.163439 Sep 21 12:22:11.967249 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 105/210] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:11 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:22:12.391872 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-8a4a972e-fc14-4c81-8493-b8bf9774f0fe tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:12.392483 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-8a4a972e-fc14-4c81-8493-b8bf9774f0fe tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:12.398568 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8a4a972e-fc14-4c81-8493-b8bf9774f0fe tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:12.399044 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8a4a972e-fc14-4c81-8493-b8bf9774f0fe tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:12.399473 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8a4a972e-fc14-4c81-8493-b8bf9774f0fe tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:12.400191 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8a4a972e-fc14-4c81-8493-b8bf9774f0fe tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:12.400643 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8a4a972e-fc14-4c81-8493-b8bf9774f0fe tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:12.401067 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8a4a972e-fc14-4c81-8493-b8bf9774f0fe tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:12.540737 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-8a4a972e-fc14-4c81-8493-b8bf9774f0fe tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:12.553429 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-8a4a972e-fc14-4c81-8493-b8bf9774f0fe tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.165960 Sep 21 12:22:12.554015 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 106/211] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:12 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:12.886592 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-58bf0735-0502-4495-9fb3-ecac87a6a7e8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:12.887183 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-58bf0735-0502-4495-9fb3-ecac87a6a7e8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:12.893425 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-58bf0735-0502-4495-9fb3-ecac87a6a7e8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:12.893917 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-58bf0735-0502-4495-9fb3-ecac87a6a7e8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:12.894354 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-58bf0735-0502-4495-9fb3-ecac87a6a7e8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:12.895046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-58bf0735-0502-4495-9fb3-ecac87a6a7e8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:12.895502 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-58bf0735-0502-4495-9fb3-ecac87a6a7e8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:12.895977 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-58bf0735-0502-4495-9fb3-ecac87a6a7e8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:12.991955 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-39c3b0a5-05ca-4983-bec5-462bfe5bfbe4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:12.992572 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-39c3b0a5-05ca-4983-bec5-462bfe5bfbe4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:12.998592 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-39c3b0a5-05ca-4983-bec5-462bfe5bfbe4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:12.999080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-39c3b0a5-05ca-4983-bec5-462bfe5bfbe4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:12.999525 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-39c3b0a5-05ca-4983-bec5-462bfe5bfbe4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:13.000246 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-39c3b0a5-05ca-4983-bec5-462bfe5bfbe4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:13.000798 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-39c3b0a5-05ca-4983-bec5-462bfe5bfbe4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:13.001139 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-39c3b0a5-05ca-4983-bec5-462bfe5bfbe4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:13.022472 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-58bf0735-0502-4495-9fb3-ecac87a6a7e8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:13.030948 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-58bf0735-0502-4495-9fb3-ecac87a6a7e8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:13.032439 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-58bf0735-0502-4495-9fb3-ecac87a6a7e8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:13.033546 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-58bf0735-0502-4495-9fb3-ecac87a6a7e8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.150897 Sep 21 12:22:13.034115 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 106/212] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:22:12 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:22:13.128544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-39c3b0a5-05ca-4983-bec5-462bfe5bfbe4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:13.136082 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-39c3b0a5-05ca-4983-bec5-462bfe5bfbe4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.149589 Sep 21 12:22:13.136649 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 107/213] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:12 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:13.577159 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-1f0f0d0a-26a4-47df-9fa4-b0a2af3f2e34 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:13.577771 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-1f0f0d0a-26a4-47df-9fa4-b0a2af3f2e34 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:13.584015 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1f0f0d0a-26a4-47df-9fa4-b0a2af3f2e34 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:13.584507 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1f0f0d0a-26a4-47df-9fa4-b0a2af3f2e34 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:13.584948 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1f0f0d0a-26a4-47df-9fa4-b0a2af3f2e34 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:13.585635 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1f0f0d0a-26a4-47df-9fa4-b0a2af3f2e34 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:13.586091 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1f0f0d0a-26a4-47df-9fa4-b0a2af3f2e34 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:13.586518 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1f0f0d0a-26a4-47df-9fa4-b0a2af3f2e34 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:13.712499 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-1f0f0d0a-26a4-47df-9fa4-b0a2af3f2e34 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:13.720053 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-1f0f0d0a-26a4-47df-9fa4-b0a2af3f2e34 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.147313 Sep 21 12:22:13.720624 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 107/214] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:13 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:14.059256 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-1873b9a3-ff48-47a4-a832-62d233c95b27 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:14.060530 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-1873b9a3-ff48-47a4-a832-62d233c95b27 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:14.066444 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1873b9a3-ff48-47a4-a832-62d233c95b27 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:14.066926 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1873b9a3-ff48-47a4-a832-62d233c95b27 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:14.067359 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1873b9a3-ff48-47a4-a832-62d233c95b27 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:14.068069 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1873b9a3-ff48-47a4-a832-62d233c95b27 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:14.068525 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1873b9a3-ff48-47a4-a832-62d233c95b27 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:14.068956 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1873b9a3-ff48-47a4-a832-62d233c95b27 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:14.158343 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-97c466c7-799e-4037-a7d1-4dc6b806caf5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:14.159075 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-97c466c7-799e-4037-a7d1-4dc6b806caf5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:14.165192 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-97c466c7-799e-4037-a7d1-4dc6b806caf5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:14.165680 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-97c466c7-799e-4037-a7d1-4dc6b806caf5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:14.166115 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-97c466c7-799e-4037-a7d1-4dc6b806caf5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:14.166810 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-97c466c7-799e-4037-a7d1-4dc6b806caf5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:14.167268 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-97c466c7-799e-4037-a7d1-4dc6b806caf5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:14.167711 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-97c466c7-799e-4037-a7d1-4dc6b806caf5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:14.194443 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-1873b9a3-ff48-47a4-a832-62d233c95b27 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:14.202591 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-1873b9a3-ff48-47a4-a832-62d233c95b27 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:14.204073 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-1873b9a3-ff48-47a4-a832-62d233c95b27 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:14.205184 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-1873b9a3-ff48-47a4-a832-62d233c95b27 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1407 microversion: 2.20 time: 0.149832 Sep 21 12:22:14.205744 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 108/215] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:22:14 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:22:14.297111 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-97c466c7-799e-4037-a7d1-4dc6b806caf5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:14.304736 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-97c466c7-799e-4037-a7d1-4dc6b806caf5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.150185 Sep 21 12:22:14.305305 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 108/216] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:14 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:22:14.742562 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-b31fa365-d541-42c5-b437-8707bbbca9f8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:14.743247 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-b31fa365-d541-42c5-b437-8707bbbca9f8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:14.749283 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b31fa365-d541-42c5-b437-8707bbbca9f8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:14.749869 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b31fa365-d541-42c5-b437-8707bbbca9f8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:14.750403 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b31fa365-d541-42c5-b437-8707bbbca9f8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:14.751398 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b31fa365-d541-42c5-b437-8707bbbca9f8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:14.751933 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b31fa365-d541-42c5-b437-8707bbbca9f8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:14.752450 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b31fa365-d541-42c5-b437-8707bbbca9f8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:14.888480 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-b31fa365-d541-42c5-b437-8707bbbca9f8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:14.896397 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-b31fa365-d541-42c5-b437-8707bbbca9f8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1315 microversion: 2.1 time: 0.157651 Sep 21 12:22:14.896975 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 109/217] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:14 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:15.230177 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-d8bf041e-8c39-43e8-aea5-9a294e27bfc5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:15.230786 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-d8bf041e-8c39-43e8-aea5-9a294e27bfc5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:15.236875 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d8bf041e-8c39-43e8-aea5-9a294e27bfc5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:15.237355 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d8bf041e-8c39-43e8-aea5-9a294e27bfc5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:15.237820 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d8bf041e-8c39-43e8-aea5-9a294e27bfc5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:15.238535 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d8bf041e-8c39-43e8-aea5-9a294e27bfc5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:15.238987 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d8bf041e-8c39-43e8-aea5-9a294e27bfc5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:15.239415 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d8bf041e-8c39-43e8-aea5-9a294e27bfc5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:15.328544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-8210bb25-84c8-484e-acea-8b977fdc1cf5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:15.329152 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-8210bb25-84c8-484e-acea-8b977fdc1cf5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:15.335496 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8210bb25-84c8-484e-acea-8b977fdc1cf5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:15.336006 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8210bb25-84c8-484e-acea-8b977fdc1cf5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:15.336443 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8210bb25-84c8-484e-acea-8b977fdc1cf5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:15.337136 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8210bb25-84c8-484e-acea-8b977fdc1cf5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:15.337587 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8210bb25-84c8-484e-acea-8b977fdc1cf5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:15.338021 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8210bb25-84c8-484e-acea-8b977fdc1cf5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:15.371662 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-d8bf041e-8c39-43e8-aea5-9a294e27bfc5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:15.405547 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-d8bf041e-8c39-43e8-aea5-9a294e27bfc5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:15.418027 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-d8bf041e-8c39-43e8-aea5-9a294e27bfc5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:15.419406 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-d8bf041e-8c39-43e8-aea5-9a294e27bfc5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1600 microversion: 2.20 time: 0.193109 Sep 21 12:22:15.432420 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 109/218] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:22:15 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1600 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:22:15.459949 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-b9bdc057-96f2-47b5-a4d4-cedd595cce46 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:15.459949 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-b9bdc057-96f2-47b5-a4d4-cedd595cce46 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:15.470356 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b9bdc057-96f2-47b5-a4d4-cedd595cce46 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:15.473237 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b9bdc057-96f2-47b5-a4d4-cedd595cce46 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:15.473451 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b9bdc057-96f2-47b5-a4d4-cedd595cce46 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:15.476212 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b9bdc057-96f2-47b5-a4d4-cedd595cce46 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:15.487576 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b9bdc057-96f2-47b5-a4d4-cedd595cce46 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:15.488330 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b9bdc057-96f2-47b5-a4d4-cedd595cce46 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:15.523118 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-8210bb25-84c8-484e-acea-8b977fdc1cf5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:15.534359 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-8210bb25-84c8-484e-acea-8b977fdc1cf5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.210299 Sep 21 12:22:15.537844 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 110/219] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:15 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:15.649806 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-b9bdc057-96f2-47b5-a4d4-cedd595cce46 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.201564 Sep 21 12:22:15.650680 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 110/220] 10.222.0.71 () {60 vars in 1316 bytes} [Wed Sep 21 12:22:15 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e/os-interface => generated 285 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 21 12:22:15.920242 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-937ca2b7-141e-44e4-8814-45f3761fe76b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:15.921036 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-937ca2b7-141e-44e4-8814-45f3761fe76b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:15.928477 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-937ca2b7-141e-44e4-8814-45f3761fe76b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:15.929127 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-937ca2b7-141e-44e4-8814-45f3761fe76b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:15.929710 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-937ca2b7-141e-44e4-8814-45f3761fe76b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:15.930581 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-937ca2b7-141e-44e4-8814-45f3761fe76b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:15.931182 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-937ca2b7-141e-44e4-8814-45f3761fe76b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:15.931926 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-937ca2b7-141e-44e4-8814-45f3761fe76b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:16.315331 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-937ca2b7-141e-44e4-8814-45f3761fe76b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:16.329642 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-937ca2b7-141e-44e4-8814-45f3761fe76b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1501 microversion: 2.1 time: 0.413605 Sep 21 12:22:16.331230 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 111/221] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:15 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1501 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:16.563289 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-b28cc91d-1852-451c-a6e8-3f4df15623ee tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:16.565213 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-b28cc91d-1852-451c-a6e8-3f4df15623ee tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:16.573953 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b28cc91d-1852-451c-a6e8-3f4df15623ee tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:16.576974 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b28cc91d-1852-451c-a6e8-3f4df15623ee tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:16.577942 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b28cc91d-1852-451c-a6e8-3f4df15623ee tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:16.579101 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b28cc91d-1852-451c-a6e8-3f4df15623ee tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:16.580244 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b28cc91d-1852-451c-a6e8-3f4df15623ee tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:16.582067 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b28cc91d-1852-451c-a6e8-3f4df15623ee tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:17.114562 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-b28cc91d-1852-451c-a6e8-3f4df15623ee tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:17.132143 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-b28cc91d-1852-451c-a6e8-3f4df15623ee tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1363 microversion: 2.1 time: 0.575085 Sep 21 12:22:17.148867 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 111/222] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:16 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1363 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:17.929885 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-c7bffdc4-e0cc-41bc-a237-4e29cba7a7ac req-90cee24c-a845-4691-aefa-3202ceb3c67a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e9ebd08-4c95-43f6-a1a4-3268532d961e", "tag": "1f39c2aa-a245-4b77-8233-20f0c6c6cb30"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:22:17.953396 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-c7bffdc4-e0cc-41bc-a237-4e29cba7a7ac req-90cee24c-a845-4691-aefa-3202ceb3c67a service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:17.954139 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-c7bffdc4-e0cc-41bc-a237-4e29cba7a7ac req-90cee24c-a845-4691-aefa-3202ceb3c67a service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:17.955091 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-c7bffdc4-e0cc-41bc-a237-4e29cba7a7ac req-90cee24c-a845-4691-aefa-3202ceb3c67a service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:17.992870 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-c7bffdc4-e0cc-41bc-a237-4e29cba7a7ac req-90cee24c-a845-4691-aefa-3202ceb3c67a service nova] Creating event network-changed:1f39c2aa-a245-4b77-8233-20f0c6c6cb30 for instance 5e9ebd08-4c95-43f6-a1a4-3268532d961e on hv-cinder-85867 Sep 21 12:22:18.008809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-c7bffdc4-e0cc-41bc-a237-4e29cba7a7ac req-90cee24c-a845-4691-aefa-3202ceb3c67a service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081394 Sep 21 12:22:18.011832 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 112/223] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:22:18.042251 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-671bc4c2-51eb-4c50-9813-90c4690e42d8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb0e2796-5372-4d7d-9bed-8a979272c411"}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:22:18.045339 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-671bc4c2-51eb-4c50-9813-90c4690e42d8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:18.052536 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-671bc4c2-51eb-4c50-9813-90c4690e42d8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:18.053600 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-671bc4c2-51eb-4c50-9813-90c4690e42d8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:18.054493 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-671bc4c2-51eb-4c50-9813-90c4690e42d8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:18.055941 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-671bc4c2-51eb-4c50-9813-90c4690e42d8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:18.056775 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-671bc4c2-51eb-4c50-9813-90c4690e42d8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:18.057440 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-671bc4c2-51eb-4c50-9813-90c4690e42d8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:18.156828 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-b2ca2c7e-6cbc-4098-ba72-f0f5bdcb309c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:18.157829 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-b2ca2c7e-6cbc-4098-ba72-f0f5bdcb309c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:18.172582 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b2ca2c7e-6cbc-4098-ba72-f0f5bdcb309c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:18.173352 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b2ca2c7e-6cbc-4098-ba72-f0f5bdcb309c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:18.174000 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b2ca2c7e-6cbc-4098-ba72-f0f5bdcb309c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:18.174893 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b2ca2c7e-6cbc-4098-ba72-f0f5bdcb309c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:18.176826 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b2ca2c7e-6cbc-4098-ba72-f0f5bdcb309c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:18.177745 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b2ca2c7e-6cbc-4098-ba72-f0f5bdcb309c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:18.711321 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-b2ca2c7e-6cbc-4098-ba72-f0f5bdcb309c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:18.748103 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-b2ca2c7e-6cbc-4098-ba72-f0f5bdcb309c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1548 microversion: 2.1 time: 0.590699 Sep 21 12:22:18.764188 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 113/224] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:18 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1548 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:22:18.776760 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-15c9fddf-8b0e-4edd-a578-ce04d0d9e0f0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:18.779661 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-15c9fddf-8b0e-4edd-a578-ce04d0d9e0f0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:18.795422 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-15c9fddf-8b0e-4edd-a578-ce04d0d9e0f0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:18.796101 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-15c9fddf-8b0e-4edd-a578-ce04d0d9e0f0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:18.796647 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-15c9fddf-8b0e-4edd-a578-ce04d0d9e0f0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:18.797573 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-671bc4c2-51eb-4c50-9813-90c4690e42d8 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "POST /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.758739 Sep 21 12:22:18.803902 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 112/225] 10.222.0.71 () {60 vars in 1323 bytes} [Wed Sep 21 12:22:18 2022] POST /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9/os-volume_attachments => generated 194 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:22:18.810530 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-15c9fddf-8b0e-4edd-a578-ce04d0d9e0f0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:18.811133 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-15c9fddf-8b0e-4edd-a578-ce04d0d9e0f0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:18.811473 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-15c9fddf-8b0e-4edd-a578-ce04d0d9e0f0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:19.075850 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-15c9fddf-8b0e-4edd-a578-ce04d0d9e0f0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.304752 Sep 21 12:22:19.076565 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 114/226] 10.222.0.71 () {58 vars in 1275 bytes} [Wed Sep 21 12:22:18 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e/os-interface => generated 284 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:22:21.034383 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-f7c8ea35-7b63-4958-9b21-9537c8010d7f req-aada7e3c-5fbf-42dc-a984-c11c24141960 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee010d1f-46d4-487e-a93e-66c5e2ac895e", "tag": "ee7ca2d0-d70f-46f5-af82-81e48a262d02"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:22:21.065008 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=74 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:21.068098 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-f7c8ea35-7b63-4958-9b21-9537c8010d7f req-aada7e3c-5fbf-42dc-a984-c11c24141960 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:21.068878 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-f7c8ea35-7b63-4958-9b21-9537c8010d7f req-aada7e3c-5fbf-42dc-a984-c11c24141960 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:21.072393 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-f7c8ea35-7b63-4958-9b21-9537c8010d7f req-aada7e3c-5fbf-42dc-a984-c11c24141960 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:21.100645 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-f7c8ea35-7b63-4958-9b21-9537c8010d7f req-aada7e3c-5fbf-42dc-a984-c11c24141960 service nova] Creating event network-changed:ee7ca2d0-d70f-46f5-af82-81e48a262d02 for instance ee010d1f-46d4-487e-a93e-66c5e2ac895e on hv-cinder-85867 Sep 21 12:22:21.112846 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-f7c8ea35-7b63-4958-9b21-9537c8010d7f req-aada7e3c-5fbf-42dc-a984-c11c24141960 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083183 Sep 21 12:22:21.116891 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 113/227] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:22:23.835408 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-06260775-1e80-478e-bb01-6f30e138c700 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2047280276", "imageRef": "1e3a8d95-6338-499c-af91-e3d1345af950", "flavorRef": "452", "networks": [{"uuid": "81a38dde-d245-4a7c-b2e5-d5b018863549"}]}} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:22:23.845297 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_api:SELECT=74 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:23.905827 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.network.neutron [None req-06260775-1e80-478e-bb01-6f30e138c700 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] validate_networks() for [('81a38dde-d245-4a7c-b2e5-d5b018863549', None, None, None, None, None)] {{(pid=120462) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 12:22:24.414623 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-06260775-1e80-478e-bb01-6f30e138c700 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Flavor limits 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 12:22:24.415156 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-06260775-1e80-478e-bb01-6f30e138c700 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Image limits 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 12:22:24.415738 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-06260775-1e80-478e-bb01-6f30e138c700 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Flavor pref 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 12:22:24.416245 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-06260775-1e80-478e-bb01-6f30e138c700 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Image pref 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 12:22:24.416727 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-06260775-1e80-478e-bb01-6f30e138c700 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 12:22:24.426824 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-06260775-1e80-478e-bb01-6f30e138c700 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:24.427317 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-06260775-1e80-478e-bb01-6f30e138c700 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:24.428003 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-06260775-1e80-478e-bb01-6f30e138c700 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:24.428735 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-06260775-1e80-478e-bb01-6f30e138c700 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:24.429369 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-06260775-1e80-478e-bb01-6f30e138c700 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:24.429808 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-06260775-1e80-478e-bb01-6f30e138c700 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:24.451845 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-06260775-1e80-478e-bb01-6f30e138c700 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Getting quotas for project c46922ef081642f6a3d8ad5d02e4155a. Resources: {'instances', 'ram', 'cores'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 12:22:24.458458 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-06260775-1e80-478e-bb01-6f30e138c700 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Getting quotas for user 1f8e995175ec4c6583e1ad0c7fb902ab and project c46922ef081642f6a3d8ad5d02e4155a. Resources: {'instances', 'ram', 'cores'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 12:22:24.475068 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-06260775-1e80-478e-bb01-6f30e138c700 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Going to run 1 instances... {{(pid=120462) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 12:22:24.478155 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-06260775-1e80-478e-bb01-6f30e138c700 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e3a8d95-6338-499c-af91-e3d1345af950',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 12:22:24.536046 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-06260775-1e80-478e-bb01-6f30e138c700 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.705351 Sep 21 12:22:24.537119 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 115/228] 10.222.0.71 () {60 vars in 1147 bytes} [Wed Sep 21 12:22:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 21 12:22:24.549559 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-d0536f6e-5de7-4ec2-a5d9-72bbf6c15dd8 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:24.550258 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-d0536f6e-5de7-4ec2-a5d9-72bbf6c15dd8 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:24.634908 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-d0536f6e-5de7-4ec2-a5d9-72bbf6c15dd8 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:24.655132 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-d0536f6e-5de7-4ec2-a5d9-72bbf6c15dd8 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 200 len: 1214 microversion: 2.1 time: 0.110611 Sep 21 12:22:24.656366 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 114/229] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:24 2022] GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:25.677778 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-364d30ee-d6e5-4026-99ee-20c9ca1c9373 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:25.678400 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-364d30ee-d6e5-4026-99ee-20c9ca1c9373 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:25.685801 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-364d30ee-d6e5-4026-99ee-20c9ca1c9373 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:25.686291 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-364d30ee-d6e5-4026-99ee-20c9ca1c9373 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:25.686730 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-364d30ee-d6e5-4026-99ee-20c9ca1c9373 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:25.687464 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-364d30ee-d6e5-4026-99ee-20c9ca1c9373 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:25.687946 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-364d30ee-d6e5-4026-99ee-20c9ca1c9373 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:25.688371 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-364d30ee-d6e5-4026-99ee-20c9ca1c9373 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:25.756534 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-364d30ee-d6e5-4026-99ee-20c9ca1c9373 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:25.773341 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-364d30ee-d6e5-4026-99ee-20c9ca1c9373 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 200 len: 1218 microversion: 2.1 time: 0.099149 Sep 21 12:22:25.774224 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 116/230] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:25 2022] GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:26.797689 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-c4f791f5-964c-4759-b205-734677377a8c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:26.798396 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-c4f791f5-964c-4759-b205-734677377a8c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:26.813258 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c4f791f5-964c-4759-b205-734677377a8c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:26.813758 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c4f791f5-964c-4759-b205-734677377a8c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:26.814197 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c4f791f5-964c-4759-b205-734677377a8c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:26.814903 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c4f791f5-964c-4759-b205-734677377a8c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:26.815485 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c4f791f5-964c-4759-b205-734677377a8c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:26.816017 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c4f791f5-964c-4759-b205-734677377a8c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:26.901169 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-c4f791f5-964c-4759-b205-734677377a8c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:26.909779 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-c4f791f5-964c-4759-b205-734677377a8c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 200 len: 1218 microversion: 2.1 time: 0.116292 Sep 21 12:22:26.910346 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 115/231] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:26 2022] GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 1218 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:27.936144 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-17d335e2-636f-4166-82bc-2d3a4b09afb4 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:27.936838 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-17d335e2-636f-4166-82bc-2d3a4b09afb4 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:27.942882 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-17d335e2-636f-4166-82bc-2d3a4b09afb4 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:27.943357 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-17d335e2-636f-4166-82bc-2d3a4b09afb4 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:27.943803 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-17d335e2-636f-4166-82bc-2d3a4b09afb4 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:27.944492 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-17d335e2-636f-4166-82bc-2d3a4b09afb4 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:27.944938 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-17d335e2-636f-4166-82bc-2d3a4b09afb4 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:27.945356 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-17d335e2-636f-4166-82bc-2d3a4b09afb4 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:28.005316 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-17d335e2-636f-4166-82bc-2d3a4b09afb4 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:28.013036 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-17d335e2-636f-4166-82bc-2d3a4b09afb4 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 200 len: 1218 microversion: 2.1 time: 0.080740 Sep 21 12:22:28.013600 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 117/232] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:27 2022] GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:29.034466 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-a6895bdc-1bfb-43d7-a670-fffba7119365 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:29.035169 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-a6895bdc-1bfb-43d7-a670-fffba7119365 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:29.041640 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a6895bdc-1bfb-43d7-a670-fffba7119365 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:29.042127 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a6895bdc-1bfb-43d7-a670-fffba7119365 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:29.042569 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a6895bdc-1bfb-43d7-a670-fffba7119365 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:29.043262 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a6895bdc-1bfb-43d7-a670-fffba7119365 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:29.044234 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a6895bdc-1bfb-43d7-a670-fffba7119365 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:29.044662 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a6895bdc-1bfb-43d7-a670-fffba7119365 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:29.113208 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a6895bdc-1bfb-43d7-a670-fffba7119365 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:29.123538 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-a6895bdc-1bfb-43d7-a670-fffba7119365 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 200 len: 1218 microversion: 2.1 time: 0.092840 Sep 21 12:22:29.124165 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 116/233] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:29 2022] GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:30.146983 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-935c793f-2e4f-44d7-95b9-842642bab3a4 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:30.147703 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-935c793f-2e4f-44d7-95b9-842642bab3a4 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:30.154023 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-935c793f-2e4f-44d7-95b9-842642bab3a4 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:30.154513 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-935c793f-2e4f-44d7-95b9-842642bab3a4 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:30.154952 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-935c793f-2e4f-44d7-95b9-842642bab3a4 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:30.155657 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-935c793f-2e4f-44d7-95b9-842642bab3a4 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:30.156148 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-935c793f-2e4f-44d7-95b9-842642bab3a4 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:30.156577 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-935c793f-2e4f-44d7-95b9-842642bab3a4 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:30.219633 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-935c793f-2e4f-44d7-95b9-842642bab3a4 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:30.227533 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-935c793f-2e4f-44d7-95b9-842642bab3a4 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 200 len: 1210 microversion: 2.1 time: 0.084416 Sep 21 12:22:30.228207 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 118/234] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:30 2022] GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:31.250933 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-dbebfd31-425b-4b43-a4b5-75eef6b8e44f tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:31.251682 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-dbebfd31-425b-4b43-a4b5-75eef6b8e44f tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:31.275100 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dbebfd31-425b-4b43-a4b5-75eef6b8e44f tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:31.279484 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dbebfd31-425b-4b43-a4b5-75eef6b8e44f tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:31.283207 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dbebfd31-425b-4b43-a4b5-75eef6b8e44f tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:31.289392 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dbebfd31-425b-4b43-a4b5-75eef6b8e44f tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:31.290495 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dbebfd31-425b-4b43-a4b5-75eef6b8e44f tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:31.291979 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dbebfd31-425b-4b43-a4b5-75eef6b8e44f tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:31.384117 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-dbebfd31-425b-4b43-a4b5-75eef6b8e44f tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:31.396186 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-dbebfd31-425b-4b43-a4b5-75eef6b8e44f tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 200 len: 1266 microversion: 2.1 time: 0.149414 Sep 21 12:22:31.396932 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 117/235] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:31 2022] GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:32.337139 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-c7c6394e-7c16-423b-b3f0-906995ae7000 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:32.338284 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-c7c6394e-7c16-423b-b3f0-906995ae7000 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:32.346191 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c7c6394e-7c16-423b-b3f0-906995ae7000 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:32.346712 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c7c6394e-7c16-423b-b3f0-906995ae7000 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:32.347154 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c7c6394e-7c16-423b-b3f0-906995ae7000 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:32.347886 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c7c6394e-7c16-423b-b3f0-906995ae7000 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:32.348350 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c7c6394e-7c16-423b-b3f0-906995ae7000 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:32.348784 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c7c6394e-7c16-423b-b3f0-906995ae7000 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:32.377018 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-c7c6394e-7c16-423b-b3f0-906995ae7000 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Going to try to terminate instance {{(pid=120462) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 12:22:32.419670 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-fe732648-040e-4f34-ac5f-9d90c72b3576 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:32.420542 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-fe732648-040e-4f34-ac5f-9d90c72b3576 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:32.427703 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fe732648-040e-4f34-ac5f-9d90c72b3576 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:32.428308 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fe732648-040e-4f34-ac5f-9d90c72b3576 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:32.429675 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fe732648-040e-4f34-ac5f-9d90c72b3576 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:32.430468 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fe732648-040e-4f34-ac5f-9d90c72b3576 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:32.431036 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fe732648-040e-4f34-ac5f-9d90c72b3576 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:32.431724 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fe732648-040e-4f34-ac5f-9d90c72b3576 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:32.479967 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-c7c6394e-7c16-423b-b3f0-906995ae7000 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "DELETE /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 204 len: 0 microversion: 2.1 time: 0.146346 Sep 21 12:22:32.480555 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 119/236] 10.222.0.71 () {58 vars in 1239 bytes} [Wed Sep 21 12:22:32 2022] DELETE /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 21 12:22:32.489140 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-4e035dd8-85a6-4e1d-9f6f-fa810c761f23 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:32.489824 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-4e035dd8-85a6-4e1d-9f6f-fa810c761f23 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:32.495692 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4e035dd8-85a6-4e1d-9f6f-fa810c761f23 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:32.496279 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4e035dd8-85a6-4e1d-9f6f-fa810c761f23 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:32.497245 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4e035dd8-85a6-4e1d-9f6f-fa810c761f23 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:32.497938 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4e035dd8-85a6-4e1d-9f6f-fa810c761f23 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:32.498394 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4e035dd8-85a6-4e1d-9f6f-fa810c761f23 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:32.498818 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4e035dd8-85a6-4e1d-9f6f-fa810c761f23 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:32.508237 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-fe732648-040e-4f34-ac5f-9d90c72b3576 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:32.517045 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-fe732648-040e-4f34-ac5f-9d90c72b3576 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 200 len: 1274 microversion: 2.1 time: 0.102191 Sep 21 12:22:32.517630 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 118/237] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:32 2022] GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 1274 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:22:32.628707 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-4e035dd8-85a6-4e1d-9f6f-fa810c761f23 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:32.632252 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:32.638319 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-4e035dd8-85a6-4e1d-9f6f-fa810c761f23 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1553 microversion: 2.1 time: 0.152750 Sep 21 12:22:32.638936 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 120/238] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:32 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:33.540107 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-1860f43c-b791-4dee-b661-411e613cc113 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:33.540725 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-1860f43c-b791-4dee-b661-411e613cc113 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:33.547066 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1860f43c-b791-4dee-b661-411e613cc113 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:33.547581 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1860f43c-b791-4dee-b661-411e613cc113 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:33.548064 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1860f43c-b791-4dee-b661-411e613cc113 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:33.548758 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1860f43c-b791-4dee-b661-411e613cc113 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:33.549213 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1860f43c-b791-4dee-b661-411e613cc113 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:33.549640 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1860f43c-b791-4dee-b661-411e613cc113 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:33.612216 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-1860f43c-b791-4dee-b661-411e613cc113 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:33.619836 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-1860f43c-b791-4dee-b661-411e613cc113 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 200 len: 1274 microversion: 2.1 time: 0.083516 Sep 21 12:22:33.620401 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 119/239] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:33 2022] GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 1274 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:33.664299 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-6ca3e53c-dd86-4a06-9571-391328763b1a tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:33.664899 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-6ca3e53c-dd86-4a06-9571-391328763b1a tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:33.671655 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6ca3e53c-dd86-4a06-9571-391328763b1a tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:33.673109 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6ca3e53c-dd86-4a06-9571-391328763b1a tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:33.673109 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6ca3e53c-dd86-4a06-9571-391328763b1a tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:33.673347 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6ca3e53c-dd86-4a06-9571-391328763b1a tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:33.673691 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6ca3e53c-dd86-4a06-9571-391328763b1a tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:33.674109 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6ca3e53c-dd86-4a06-9571-391328763b1a tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:33.807837 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-6ca3e53c-dd86-4a06-9571-391328763b1a tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:33.816074 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-6ca3e53c-dd86-4a06-9571-391328763b1a tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1553 microversion: 2.1 time: 0.156198 Sep 21 12:22:33.816670 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 121/240] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:33 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:34.642255 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-aba1faa0-9236-4e31-8133-2bc0d7f62692 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:34.642961 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-aba1faa0-9236-4e31-8133-2bc0d7f62692 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:34.650439 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-aba1faa0-9236-4e31-8133-2bc0d7f62692 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:34.651033 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-aba1faa0-9236-4e31-8133-2bc0d7f62692 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:34.651543 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-aba1faa0-9236-4e31-8133-2bc0d7f62692 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:34.652348 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-aba1faa0-9236-4e31-8133-2bc0d7f62692 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:34.652875 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-aba1faa0-9236-4e31-8133-2bc0d7f62692 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:34.653368 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-aba1faa0-9236-4e31-8133-2bc0d7f62692 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:34.653995 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell0:SELECT=2 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:34.724920 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-aba1faa0-9236-4e31-8133-2bc0d7f62692 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:34.728293 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:34.734208 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-aba1faa0-9236-4e31-8133-2bc0d7f62692 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 200 len: 1284 microversion: 2.1 time: 0.096003 Sep 21 12:22:34.734797 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 120/241] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:34 2022] GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 1284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:34.839588 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-c4e96a95-a947-4a19-a3cc-082c68ddb565 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:34.840157 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-c4e96a95-a947-4a19-a3cc-082c68ddb565 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:34.842572 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell0:SELECT=2 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:34.843395 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell0:SELECT=6 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:34.849934 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c4e96a95-a947-4a19-a3cc-082c68ddb565 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:34.850591 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c4e96a95-a947-4a19-a3cc-082c68ddb565 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:34.851049 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c4e96a95-a947-4a19-a3cc-082c68ddb565 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:34.851797 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c4e96a95-a947-4a19-a3cc-082c68ddb565 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:34.852262 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c4e96a95-a947-4a19-a3cc-082c68ddb565 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:34.852689 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c4e96a95-a947-4a19-a3cc-082c68ddb565 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:34.983362 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-c4e96a95-a947-4a19-a3cc-082c68ddb565 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:34.992064 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-c4e96a95-a947-4a19-a3cc-082c68ddb565 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1553 microversion: 2.1 time: 0.156381 Sep 21 12:22:34.992625 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 122/242] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:34 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:35.757516 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-698f440b-57ec-4619-ad48-eaea65f9e46b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:35.758137 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-698f440b-57ec-4619-ad48-eaea65f9e46b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:35.766164 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-698f440b-57ec-4619-ad48-eaea65f9e46b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:35.766568 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-698f440b-57ec-4619-ad48-eaea65f9e46b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:35.767006 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-698f440b-57ec-4619-ad48-eaea65f9e46b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:35.767705 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-698f440b-57ec-4619-ad48-eaea65f9e46b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:35.768186 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-698f440b-57ec-4619-ad48-eaea65f9e46b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:35.768612 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-698f440b-57ec-4619-ad48-eaea65f9e46b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:35.830932 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-698f440b-57ec-4619-ad48-eaea65f9e46b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:35.838862 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-698f440b-57ec-4619-ad48-eaea65f9e46b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 200 len: 1284 microversion: 2.1 time: 0.085368 Sep 21 12:22:35.839430 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 121/243] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:35 2022] GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:36.014737 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-b2c9c85d-3028-472c-af25-4caccfc66c52 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:36.015304 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-b2c9c85d-3028-472c-af25-4caccfc66c52 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:36.021405 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b2c9c85d-3028-472c-af25-4caccfc66c52 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:36.022173 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b2c9c85d-3028-472c-af25-4caccfc66c52 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:36.022620 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b2c9c85d-3028-472c-af25-4caccfc66c52 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:36.023314 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b2c9c85d-3028-472c-af25-4caccfc66c52 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:36.023794 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b2c9c85d-3028-472c-af25-4caccfc66c52 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:36.024224 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b2c9c85d-3028-472c-af25-4caccfc66c52 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:36.153522 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-b2c9c85d-3028-472c-af25-4caccfc66c52 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:36.162374 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-b2c9c85d-3028-472c-af25-4caccfc66c52 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1553 microversion: 2.1 time: 0.151527 Sep 21 12:22:36.162950 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 123/244] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:36 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:36.861507 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-a6df5efa-0cbb-4e63-a6a2-d64712a4495b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:36.862127 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-a6df5efa-0cbb-4e63-a6a2-d64712a4495b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:36.868612 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a6df5efa-0cbb-4e63-a6a2-d64712a4495b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:36.869097 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a6df5efa-0cbb-4e63-a6a2-d64712a4495b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:36.869536 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a6df5efa-0cbb-4e63-a6a2-d64712a4495b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:36.870223 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a6df5efa-0cbb-4e63-a6a2-d64712a4495b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:36.870679 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a6df5efa-0cbb-4e63-a6a2-d64712a4495b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:36.871107 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a6df5efa-0cbb-4e63-a6a2-d64712a4495b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:36.936211 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a6df5efa-0cbb-4e63-a6a2-d64712a4495b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:36.943735 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-a6df5efa-0cbb-4e63-a6a2-d64712a4495b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 200 len: 1284 microversion: 2.1 time: 0.086324 Sep 21 12:22:36.944358 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 122/245] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:36 2022] GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:37.186942 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-b4319261-156a-4da6-936f-c0ed2e4b4463 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:37.187494 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-b4319261-156a-4da6-936f-c0ed2e4b4463 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:37.193876 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b4319261-156a-4da6-936f-c0ed2e4b4463 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:37.194372 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b4319261-156a-4da6-936f-c0ed2e4b4463 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:37.194845 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b4319261-156a-4da6-936f-c0ed2e4b4463 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:37.195547 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b4319261-156a-4da6-936f-c0ed2e4b4463 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:37.196031 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b4319261-156a-4da6-936f-c0ed2e4b4463 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:37.196461 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b4319261-156a-4da6-936f-c0ed2e4b4463 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:37.332253 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-b4319261-156a-4da6-936f-c0ed2e4b4463 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:37.340761 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-b4319261-156a-4da6-936f-c0ed2e4b4463 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1553 microversion: 2.1 time: 0.158382 Sep 21 12:22:37.341325 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 124/246] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:37 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:37.968802 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-b9a78170-192a-4315-a54e-efa59fb86675 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:37.984334 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-b9a78170-192a-4315-a54e-efa59fb86675 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:37.995051 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b9a78170-192a-4315-a54e-efa59fb86675 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:37.996195 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b9a78170-192a-4315-a54e-efa59fb86675 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:37.997957 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b9a78170-192a-4315-a54e-efa59fb86675 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:37.998939 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b9a78170-192a-4315-a54e-efa59fb86675 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:37.999612 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b9a78170-192a-4315-a54e-efa59fb86675 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:38.000307 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b9a78170-192a-4315-a54e-efa59fb86675 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:38.110678 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-b9a78170-192a-4315-a54e-efa59fb86675 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:38.121700 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-b9a78170-192a-4315-a54e-efa59fb86675 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 200 len: 1284 microversion: 2.1 time: 0.157862 Sep 21 12:22:38.122836 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 123/247] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:37 2022] GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 1284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:38.362993 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-bc3b2b10-0a05-4dbb-b788-a9f77aa786af tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:38.363666 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-bc3b2b10-0a05-4dbb-b788-a9f77aa786af tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:38.369694 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bc3b2b10-0a05-4dbb-b788-a9f77aa786af tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:38.370441 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bc3b2b10-0a05-4dbb-b788-a9f77aa786af tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:38.371201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bc3b2b10-0a05-4dbb-b788-a9f77aa786af tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:38.371926 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bc3b2b10-0a05-4dbb-b788-a9f77aa786af tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:38.372377 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bc3b2b10-0a05-4dbb-b788-a9f77aa786af tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:38.373317 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bc3b2b10-0a05-4dbb-b788-a9f77aa786af tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:38.566887 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-bc3b2b10-0a05-4dbb-b788-a9f77aa786af tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:38.579775 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-bc3b2b10-0a05-4dbb-b788-a9f77aa786af tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1553 microversion: 2.1 time: 0.221027 Sep 21 12:22:38.581628 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 125/248] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:38 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1553 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:22:39.145587 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-294d55c6-d800-416b-9532-09e192b985f0 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:39.146190 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-294d55c6-d800-416b-9532-09e192b985f0 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:39.152239 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-294d55c6-d800-416b-9532-09e192b985f0 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:39.152723 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-294d55c6-d800-416b-9532-09e192b985f0 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:39.153160 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-294d55c6-d800-416b-9532-09e192b985f0 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:39.153894 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-294d55c6-d800-416b-9532-09e192b985f0 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:39.154514 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-294d55c6-d800-416b-9532-09e192b985f0 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:39.155244 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-294d55c6-d800-416b-9532-09e192b985f0 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:39.297151 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-294d55c6-d800-416b-9532-09e192b985f0 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:39.304773 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-294d55c6-d800-416b-9532-09e192b985f0 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 200 len: 1314 microversion: 2.1 time: 0.162870 Sep 21 12:22:39.305266 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 124/249] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:39 2022] GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:39.602990 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-e1421559-b8b7-43a3-82e6-e31d6a7ac353 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:39.603604 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-e1421559-b8b7-43a3-82e6-e31d6a7ac353 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:39.609943 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e1421559-b8b7-43a3-82e6-e31d6a7ac353 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:39.610423 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e1421559-b8b7-43a3-82e6-e31d6a7ac353 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:39.610854 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e1421559-b8b7-43a3-82e6-e31d6a7ac353 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:39.611549 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e1421559-b8b7-43a3-82e6-e31d6a7ac353 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:39.612021 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e1421559-b8b7-43a3-82e6-e31d6a7ac353 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:39.612444 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e1421559-b8b7-43a3-82e6-e31d6a7ac353 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:39.773538 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-e1421559-b8b7-43a3-82e6-e31d6a7ac353 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:39.781892 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-e1421559-b8b7-43a3-82e6-e31d6a7ac353 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1553 microversion: 2.1 time: 0.182565 Sep 21 12:22:39.782480 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 126/250] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:39 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1553 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:40.328866 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-9ce77b46-ed32-49c0-85bf-bae0b3a8b010 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:40.329482 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-9ce77b46-ed32-49c0-85bf-bae0b3a8b010 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:40.336577 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9ce77b46-ed32-49c0-85bf-bae0b3a8b010 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:40.337219 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9ce77b46-ed32-49c0-85bf-bae0b3a8b010 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:40.337667 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9ce77b46-ed32-49c0-85bf-bae0b3a8b010 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:40.338368 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9ce77b46-ed32-49c0-85bf-bae0b3a8b010 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:40.342195 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9ce77b46-ed32-49c0-85bf-bae0b3a8b010 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:40.342808 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9ce77b46-ed32-49c0-85bf-bae0b3a8b010 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:40.483922 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-9ce77b46-ed32-49c0-85bf-bae0b3a8b010 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:40.491692 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-9ce77b46-ed32-49c0-85bf-bae0b3a8b010 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 200 len: 1314 microversion: 2.1 time: 0.167308 Sep 21 12:22:40.492325 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 125/251] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:40 2022] GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:40.804629 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-b4bf6b5e-21ab-4646-bb76-a8ff4c7c570c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:40.805813 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-b4bf6b5e-21ab-4646-bb76-a8ff4c7c570c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:40.812908 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b4bf6b5e-21ab-4646-bb76-a8ff4c7c570c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:40.813431 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b4bf6b5e-21ab-4646-bb76-a8ff4c7c570c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:40.813867 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b4bf6b5e-21ab-4646-bb76-a8ff4c7c570c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:40.814823 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b4bf6b5e-21ab-4646-bb76-a8ff4c7c570c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:40.815408 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b4bf6b5e-21ab-4646-bb76-a8ff4c7c570c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:40.816207 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b4bf6b5e-21ab-4646-bb76-a8ff4c7c570c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:41.059478 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-b4bf6b5e-21ab-4646-bb76-a8ff4c7c570c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:41.070490 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-b4bf6b5e-21ab-4646-bb76-a8ff4c7c570c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1553 microversion: 2.1 time: 0.269837 Sep 21 12:22:41.071370 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 127/252] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:40 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1553 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:41.281668 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-35fcf6e3-9cb5-449e-9244-1190a85678ea req-a7b34d7a-427c-4066-827e-7ff7f49125d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93785b09-4e56-42e1-865e-99e8059e0ce2", "tag": "7e905c9f-4fc1-4edd-8baf-ae4b1a56d65d"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:22:41.291881 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-35fcf6e3-9cb5-449e-9244-1190a85678ea req-a7b34d7a-427c-4066-827e-7ff7f49125d7 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:41.292603 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-35fcf6e3-9cb5-449e-9244-1190a85678ea req-a7b34d7a-427c-4066-827e-7ff7f49125d7 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:41.293193 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-35fcf6e3-9cb5-449e-9244-1190a85678ea req-a7b34d7a-427c-4066-827e-7ff7f49125d7 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:41.306123 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-35fcf6e3-9cb5-449e-9244-1190a85678ea req-a7b34d7a-427c-4066-827e-7ff7f49125d7 service nova] Creating event network-changed:7e905c9f-4fc1-4edd-8baf-ae4b1a56d65d for instance 93785b09-4e56-42e1-865e-99e8059e0ce2 on hv-cinder-85867 Sep 21 12:22:41.311786 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-35fcf6e3-9cb5-449e-9244-1190a85678ea req-a7b34d7a-427c-4066-827e-7ff7f49125d7 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034049 Sep 21 12:22:41.312423 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 126/253] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:22:41.515708 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-47591a6b-7c4e-4151-ae82-e4cdd00ade79 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:41.516462 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-47591a6b-7c4e-4151-ae82-e4cdd00ade79 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:41.522860 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-47591a6b-7c4e-4151-ae82-e4cdd00ade79 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:41.523527 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-47591a6b-7c4e-4151-ae82-e4cdd00ade79 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:41.524211 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-47591a6b-7c4e-4151-ae82-e4cdd00ade79 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:41.524946 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-47591a6b-7c4e-4151-ae82-e4cdd00ade79 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:41.525585 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-47591a6b-7c4e-4151-ae82-e4cdd00ade79 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:41.526017 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-47591a6b-7c4e-4151-ae82-e4cdd00ade79 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:41.682616 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-47591a6b-7c4e-4151-ae82-e4cdd00ade79 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:41.690698 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-47591a6b-7c4e-4151-ae82-e4cdd00ade79 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 200 len: 1314 microversion: 2.1 time: 0.179975 Sep 21 12:22:41.691325 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 128/254] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:41 2022] GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:42.094032 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-540b9bfa-1405-4e28-94ea-a0a26c53f28b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:42.094737 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-540b9bfa-1405-4e28-94ea-a0a26c53f28b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:42.101918 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-540b9bfa-1405-4e28-94ea-a0a26c53f28b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:42.102408 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-540b9bfa-1405-4e28-94ea-a0a26c53f28b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:42.102856 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-540b9bfa-1405-4e28-94ea-a0a26c53f28b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:42.103742 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-540b9bfa-1405-4e28-94ea-a0a26c53f28b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:42.104602 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-540b9bfa-1405-4e28-94ea-a0a26c53f28b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:42.105033 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-540b9bfa-1405-4e28-94ea-a0a26c53f28b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:42.275325 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-540b9bfa-1405-4e28-94ea-a0a26c53f28b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:42.284647 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-540b9bfa-1405-4e28-94ea-a0a26c53f28b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1553 microversion: 2.1 time: 0.194912 Sep 21 12:22:42.285299 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 127/255] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:42 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1553 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:42.714715 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-c89033c3-cc0b-4413-8e20-93b49b2076fd tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:42.715406 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-c89033c3-cc0b-4413-8e20-93b49b2076fd tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:42.721545 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c89033c3-cc0b-4413-8e20-93b49b2076fd tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:42.722028 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c89033c3-cc0b-4413-8e20-93b49b2076fd tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:42.722591 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c89033c3-cc0b-4413-8e20-93b49b2076fd tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:42.723149 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c89033c3-cc0b-4413-8e20-93b49b2076fd tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:42.723598 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c89033c3-cc0b-4413-8e20-93b49b2076fd tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:42.724049 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c89033c3-cc0b-4413-8e20-93b49b2076fd tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:42.862962 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-c89033c3-cc0b-4413-8e20-93b49b2076fd tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:42.871574 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-c89033c3-cc0b-4413-8e20-93b49b2076fd tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 200 len: 1314 microversion: 2.1 time: 0.160852 Sep 21 12:22:42.872470 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 129/256] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:42 2022] GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:43.308396 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-88983edb-55a6-4d97-8984-79fab082bf09 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:43.309161 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-88983edb-55a6-4d97-8984-79fab082bf09 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:43.315553 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-88983edb-55a6-4d97-8984-79fab082bf09 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:43.316072 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-88983edb-55a6-4d97-8984-79fab082bf09 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:43.316507 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-88983edb-55a6-4d97-8984-79fab082bf09 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:43.317380 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-88983edb-55a6-4d97-8984-79fab082bf09 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:43.317843 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-88983edb-55a6-4d97-8984-79fab082bf09 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:43.318272 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-88983edb-55a6-4d97-8984-79fab082bf09 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:43.461183 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-88983edb-55a6-4d97-8984-79fab082bf09 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:43.470504 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-88983edb-55a6-4d97-8984-79fab082bf09 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1553 microversion: 2.1 time: 0.165971 Sep 21 12:22:43.471085 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 128/257] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:43 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:43.896527 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-096ba94d-e54f-4cf1-b87e-5d47e36ca7f3 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:43.898060 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-096ba94d-e54f-4cf1-b87e-5d47e36ca7f3 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:43.906025 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-096ba94d-e54f-4cf1-b87e-5d47e36ca7f3 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:43.906742 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-096ba94d-e54f-4cf1-b87e-5d47e36ca7f3 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:43.907364 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-096ba94d-e54f-4cf1-b87e-5d47e36ca7f3 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:43.908763 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-096ba94d-e54f-4cf1-b87e-5d47e36ca7f3 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:43.909377 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-096ba94d-e54f-4cf1-b87e-5d47e36ca7f3 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:43.909945 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-096ba94d-e54f-4cf1-b87e-5d47e36ca7f3 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:44.145448 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-096ba94d-e54f-4cf1-b87e-5d47e36ca7f3 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:44.155001 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-096ba94d-e54f-4cf1-b87e-5d47e36ca7f3 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 200 len: 1314 microversion: 2.1 time: 0.263890 Sep 21 12:22:44.155972 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 130/258] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:43 2022] GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:44.495786 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-eaf048ca-234f-46c4-aa89-149cecc54e8b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:44.497760 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-eaf048ca-234f-46c4-aa89-149cecc54e8b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:44.506041 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eaf048ca-234f-46c4-aa89-149cecc54e8b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:44.506583 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eaf048ca-234f-46c4-aa89-149cecc54e8b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:44.507013 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eaf048ca-234f-46c4-aa89-149cecc54e8b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:44.507974 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eaf048ca-234f-46c4-aa89-149cecc54e8b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:44.508412 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eaf048ca-234f-46c4-aa89-149cecc54e8b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:44.508831 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eaf048ca-234f-46c4-aa89-149cecc54e8b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:44.728017 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-eaf048ca-234f-46c4-aa89-149cecc54e8b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:44.740420 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-eaf048ca-234f-46c4-aa89-149cecc54e8b tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1553 microversion: 2.1 time: 0.249500 Sep 21 12:22:44.741372 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 129/259] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:44 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1553 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:45.178795 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-eeb0841a-cc4b-4b0b-9398-4f142de59f53 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:45.180885 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-eeb0841a-cc4b-4b0b-9398-4f142de59f53 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:45.190371 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-eeb0841a-cc4b-4b0b-9398-4f142de59f53 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:45.191664 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-eeb0841a-cc4b-4b0b-9398-4f142de59f53 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:45.192270 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-eeb0841a-cc4b-4b0b-9398-4f142de59f53 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:45.193390 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-eeb0841a-cc4b-4b0b-9398-4f142de59f53 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:45.194034 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-eeb0841a-cc4b-4b0b-9398-4f142de59f53 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:45.194606 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-eeb0841a-cc4b-4b0b-9398-4f142de59f53 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:45.411306 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-1bbef574-2dbb-4cfd-b73c-e70a9ca266c4 req-d0247e07-c056-49cf-9817-0b38ca6b4481 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b11d666e-1c68-4889-b80e-a66aa10e05e9", "name": "network-vif-deleted", "tag": "9b27a8b0-6e14-43db-b7d2-00fb7465cce0"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:22:45.428241 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-1bbef574-2dbb-4cfd-b73c-e70a9ca266c4 req-d0247e07-c056-49cf-9817-0b38ca6b4481 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:45.429096 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-1bbef574-2dbb-4cfd-b73c-e70a9ca266c4 req-d0247e07-c056-49cf-9817-0b38ca6b4481 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:45.429738 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-1bbef574-2dbb-4cfd-b73c-e70a9ca266c4 req-d0247e07-c056-49cf-9817-0b38ca6b4481 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:45.442561 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-1bbef574-2dbb-4cfd-b73c-e70a9ca266c4 req-d0247e07-c056-49cf-9817-0b38ca6b4481 service nova] Creating event network-vif-deleted:9b27a8b0-6e14-43db-b7d2-00fb7465cce0 for instance b11d666e-1c68-4889-b80e-a66aa10e05e9 on hv-cinder-85867 Sep 21 12:22:45.449026 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-1bbef574-2dbb-4cfd-b73c-e70a9ca266c4 req-d0247e07-c056-49cf-9817-0b38ca6b4481 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043582 Sep 21 12:22:45.449677 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 130/260] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 12:22:45.475999 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-eeb0841a-cc4b-4b0b-9398-4f142de59f53 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:45.485283 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-eeb0841a-cc4b-4b0b-9398-4f142de59f53 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 200 len: 1314 microversion: 2.1 time: 0.311017 Sep 21 12:22:45.486191 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 131/261] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:45 2022] GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:45.770519 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-77ef9fbb-f013-4d4b-a2de-5b176e9a8d64 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:45.771233 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-77ef9fbb-f013-4d4b-a2de-5b176e9a8d64 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:45.786597 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-77ef9fbb-f013-4d4b-a2de-5b176e9a8d64 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:45.786979 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-77ef9fbb-f013-4d4b-a2de-5b176e9a8d64 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:45.787516 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-77ef9fbb-f013-4d4b-a2de-5b176e9a8d64 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:45.788143 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-77ef9fbb-f013-4d4b-a2de-5b176e9a8d64 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:45.788599 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-77ef9fbb-f013-4d4b-a2de-5b176e9a8d64 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:45.790222 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-77ef9fbb-f013-4d4b-a2de-5b176e9a8d64 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:45.856820 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-77ef9fbb-f013-4d4b-a2de-5b176e9a8d64 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:45.865871 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-77ef9fbb-f013-4d4b-a2de-5b176e9a8d64 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1511 microversion: 2.1 time: 0.100154 Sep 21 12:22:45.866720 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 131/262] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:45 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1511 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:46.519678 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-8d73fe7c-808c-47f2-b70d-57e0e3ced68e tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:46.520269 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-8d73fe7c-808c-47f2-b70d-57e0e3ced68e tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:46.527562 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8d73fe7c-808c-47f2-b70d-57e0e3ced68e tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:46.528338 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8d73fe7c-808c-47f2-b70d-57e0e3ced68e tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:46.529573 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8d73fe7c-808c-47f2-b70d-57e0e3ced68e tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:46.531310 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8d73fe7c-808c-47f2-b70d-57e0e3ced68e tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:46.532157 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8d73fe7c-808c-47f2-b70d-57e0e3ced68e tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:46.533020 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8d73fe7c-808c-47f2-b70d-57e0e3ced68e tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:46.726615 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-8d73fe7c-808c-47f2-b70d-57e0e3ced68e tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:46.737150 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-8d73fe7c-808c-47f2-b70d-57e0e3ced68e tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 200 len: 1314 microversion: 2.1 time: 0.224483 Sep 21 12:22:46.737765 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 132/263] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:46 2022] GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:46.892144 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-b10c5157-e1a8-4c2b-88a3-7c2e70c11c75 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:46.893599 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-b10c5157-e1a8-4c2b-88a3-7c2e70c11c75 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:46.901899 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b10c5157-e1a8-4c2b-88a3-7c2e70c11c75 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:46.902403 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b10c5157-e1a8-4c2b-88a3-7c2e70c11c75 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:46.903120 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b10c5157-e1a8-4c2b-88a3-7c2e70c11c75 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:46.904498 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b10c5157-e1a8-4c2b-88a3-7c2e70c11c75 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:46.904962 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b10c5157-e1a8-4c2b-88a3-7c2e70c11c75 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:46.905563 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b10c5157-e1a8-4c2b-88a3-7c2e70c11c75 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:46.997952 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-b10c5157-e1a8-4c2b-88a3-7c2e70c11c75 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:47.009289 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-b10c5157-e1a8-4c2b-88a3-7c2e70c11c75 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1511 microversion: 2.1 time: 0.122589 Sep 21 12:22:47.010322 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 132/264] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:46 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1511 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:47.761987 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-e68fd7f0-a012-4819-9765-5314cd5644d8 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:47.765268 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-e68fd7f0-a012-4819-9765-5314cd5644d8 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:47.771408 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e68fd7f0-a012-4819-9765-5314cd5644d8 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:47.772148 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e68fd7f0-a012-4819-9765-5314cd5644d8 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:47.772932 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e68fd7f0-a012-4819-9765-5314cd5644d8 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:47.773791 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e68fd7f0-a012-4819-9765-5314cd5644d8 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:47.774426 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e68fd7f0-a012-4819-9765-5314cd5644d8 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:47.775004 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e68fd7f0-a012-4819-9765-5314cd5644d8 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:47.982250 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-e68fd7f0-a012-4819-9765-5314cd5644d8 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:47.995458 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-e68fd7f0-a012-4819-9765-5314cd5644d8 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 200 len: 1314 microversion: 2.1 time: 0.237197 Sep 21 12:22:48.025365 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 133/265] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:47 2022] GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:22:48.038691 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-776a3275-b700-4af8-a323-1af5015e202e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:48.040053 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-776a3275-b700-4af8-a323-1af5015e202e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:48.050082 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-776a3275-b700-4af8-a323-1af5015e202e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:48.050614 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-776a3275-b700-4af8-a323-1af5015e202e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:48.051066 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-776a3275-b700-4af8-a323-1af5015e202e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:48.051803 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-776a3275-b700-4af8-a323-1af5015e202e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:48.052274 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-776a3275-b700-4af8-a323-1af5015e202e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:48.053016 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-776a3275-b700-4af8-a323-1af5015e202e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:48.131873 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-776a3275-b700-4af8-a323-1af5015e202e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:48.141860 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-776a3275-b700-4af8-a323-1af5015e202e tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1346 microversion: 2.1 time: 0.111808 Sep 21 12:22:48.142637 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 133/266] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:48 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1346 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:49.032784 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-d84e57b3-d193-4b72-8f91-35dc2f581083 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:49.034847 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-d84e57b3-d193-4b72-8f91-35dc2f581083 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:49.042739 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d84e57b3-d193-4b72-8f91-35dc2f581083 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:49.043617 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d84e57b3-d193-4b72-8f91-35dc2f581083 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:49.044965 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d84e57b3-d193-4b72-8f91-35dc2f581083 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:49.046232 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d84e57b3-d193-4b72-8f91-35dc2f581083 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:49.046930 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d84e57b3-d193-4b72-8f91-35dc2f581083 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:49.048415 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d84e57b3-d193-4b72-8f91-35dc2f581083 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:49.165677 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-d0725ab3-3546-45dc-971c-5d312216a905 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:49.166285 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-d0725ab3-3546-45dc-971c-5d312216a905 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:49.174390 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d0725ab3-3546-45dc-971c-5d312216a905 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:49.175288 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d0725ab3-3546-45dc-971c-5d312216a905 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:49.176043 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d0725ab3-3546-45dc-971c-5d312216a905 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:49.177205 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d0725ab3-3546-45dc-971c-5d312216a905 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:49.177945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d0725ab3-3546-45dc-971c-5d312216a905 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:49.178788 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d0725ab3-3546-45dc-971c-5d312216a905 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:49.200305 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-d84e57b3-d193-4b72-8f91-35dc2f581083 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:49.211875 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-d84e57b3-d193-4b72-8f91-35dc2f581083 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 200 len: 1314 microversion: 2.1 time: 0.184205 Sep 21 12:22:49.212428 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 134/267] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:49 2022] GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:22:49.270668 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-d0725ab3-3546-45dc-971c-5d312216a905 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:49.280642 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-d0725ab3-3546-45dc-971c-5d312216a905 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1346 microversion: 2.1 time: 0.118550 Sep 21 12:22:49.281426 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 134/268] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:49 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1346 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:22:50.237699 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-8a5e463f-94b8-40a4-a4bd-781f9952582e tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:50.238253 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-8a5e463f-94b8-40a4-a4bd-781f9952582e tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:50.244201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8a5e463f-94b8-40a4-a4bd-781f9952582e tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:50.244704 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8a5e463f-94b8-40a4-a4bd-781f9952582e tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:50.245152 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8a5e463f-94b8-40a4-a4bd-781f9952582e tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:50.245845 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8a5e463f-94b8-40a4-a4bd-781f9952582e tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:50.246297 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8a5e463f-94b8-40a4-a4bd-781f9952582e tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:50.246720 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8a5e463f-94b8-40a4-a4bd-781f9952582e tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:50.314249 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-c0bdbd6a-573f-44c0-af95-268ee25b5445 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:50.314862 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-c0bdbd6a-573f-44c0-af95-268ee25b5445 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:50.321315 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0bdbd6a-573f-44c0-af95-268ee25b5445 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:50.321806 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0bdbd6a-573f-44c0-af95-268ee25b5445 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:50.322247 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0bdbd6a-573f-44c0-af95-268ee25b5445 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:50.322947 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0bdbd6a-573f-44c0-af95-268ee25b5445 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:50.323402 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0bdbd6a-573f-44c0-af95-268ee25b5445 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:50.323854 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0bdbd6a-573f-44c0-af95-268ee25b5445 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:50.382704 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-8a5e463f-94b8-40a4-a4bd-781f9952582e tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:50.390944 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-8a5e463f-94b8-40a4-a4bd-781f9952582e tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 200 len: 1314 microversion: 2.1 time: 0.157058 Sep 21 12:22:50.391546 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 135/269] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:50 2022] GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:50.520910 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-c0bdbd6a-573f-44c0-af95-268ee25b5445 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:50.529906 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-c0bdbd6a-573f-44c0-af95-268ee25b5445 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1346 microversion: 2.1 time: 0.220095 Sep 21 12:22:50.530528 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 135/270] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:50 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1346 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:22:51.413999 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-975da5c1-ffba-48bd-8a8a-8180b8124173 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:51.414682 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-975da5c1-ffba-48bd-8a8a-8180b8124173 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:51.421181 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-975da5c1-ffba-48bd-8a8a-8180b8124173 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:51.421675 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-975da5c1-ffba-48bd-8a8a-8180b8124173 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:51.422114 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-975da5c1-ffba-48bd-8a8a-8180b8124173 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:51.422811 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-975da5c1-ffba-48bd-8a8a-8180b8124173 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:51.423270 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-975da5c1-ffba-48bd-8a8a-8180b8124173 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:51.423698 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-975da5c1-ffba-48bd-8a8a-8180b8124173 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:51.552969 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-7352c02a-4cbf-4265-9fbb-c494c54056d2 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:51.553612 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-7352c02a-4cbf-4265-9fbb-c494c54056d2 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:51.555522 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-975da5c1-ffba-48bd-8a8a-8180b8124173 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:51.556047 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=48 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:51.561993 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7352c02a-4cbf-4265-9fbb-c494c54056d2 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:51.562483 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7352c02a-4cbf-4265-9fbb-c494c54056d2 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:51.562922 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7352c02a-4cbf-4265-9fbb-c494c54056d2 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:51.563618 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7352c02a-4cbf-4265-9fbb-c494c54056d2 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:51.563801 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-975da5c1-ffba-48bd-8a8a-8180b8124173 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 200 len: 1314 microversion: 2.1 time: 0.153660 Sep 21 12:22:51.564110 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7352c02a-4cbf-4265-9fbb-c494c54056d2 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:51.564380 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 136/271] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:51 2022] GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:51.564534 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7352c02a-4cbf-4265-9fbb-c494c54056d2 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:51.625934 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-7352c02a-4cbf-4265-9fbb-c494c54056d2 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:51.635789 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-7352c02a-4cbf-4265-9fbb-c494c54056d2 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1346 microversion: 2.1 time: 0.086584 Sep 21 12:22:51.642846 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 136/272] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:51 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:22:52.586652 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-5d480c93-67a2-47f2-81e7-7c6dfd557102 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:52.587255 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-5d480c93-67a2-47f2-81e7-7c6dfd557102 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:52.593538 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5d480c93-67a2-47f2-81e7-7c6dfd557102 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:52.594010 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5d480c93-67a2-47f2-81e7-7c6dfd557102 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:52.594440 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5d480c93-67a2-47f2-81e7-7c6dfd557102 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:52.595127 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5d480c93-67a2-47f2-81e7-7c6dfd557102 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:52.595575 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5d480c93-67a2-47f2-81e7-7c6dfd557102 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:52.596022 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5d480c93-67a2-47f2-81e7-7c6dfd557102 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:52.613772 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=100 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:52.673247 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-173792c5-b0f1-46f9-b49c-36153d1069ee tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:52.673856 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-173792c5-b0f1-46f9-b49c-36153d1069ee tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:52.681080 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-173792c5-b0f1-46f9-b49c-36153d1069ee tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:52.681558 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-173792c5-b0f1-46f9-b49c-36153d1069ee tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:52.682157 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-173792c5-b0f1-46f9-b49c-36153d1069ee tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:52.682975 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-173792c5-b0f1-46f9-b49c-36153d1069ee tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:52.683409 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-173792c5-b0f1-46f9-b49c-36153d1069ee tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:52.684007 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-173792c5-b0f1-46f9-b49c-36153d1069ee tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:52.730716 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-5d480c93-67a2-47f2-81e7-7c6dfd557102 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:52.738531 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-5d480c93-67a2-47f2-81e7-7c6dfd557102 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 200 len: 1314 microversion: 2.1 time: 0.155660 Sep 21 12:22:52.739190 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 137/273] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:52 2022] GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:52.763727 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-173792c5-b0f1-46f9-b49c-36153d1069ee tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:52.771389 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-173792c5-b0f1-46f9-b49c-36153d1069ee tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1346 microversion: 2.1 time: 0.102016 Sep 21 12:22:52.772100 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 137/274] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:52 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1346 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:22:53.761226 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-5b4558eb-03b6-490a-8a18-456125d52e27 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:53.761833 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-5b4558eb-03b6-490a-8a18-456125d52e27 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:53.769749 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5b4558eb-03b6-490a-8a18-456125d52e27 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:53.770233 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5b4558eb-03b6-490a-8a18-456125d52e27 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:53.770664 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5b4558eb-03b6-490a-8a18-456125d52e27 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:53.771830 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5b4558eb-03b6-490a-8a18-456125d52e27 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:53.772289 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5b4558eb-03b6-490a-8a18-456125d52e27 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:53.772714 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5b4558eb-03b6-490a-8a18-456125d52e27 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:53.793267 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-11b942ea-32a0-4008-ab69-3b5f9f0b0757 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:53.793874 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-11b942ea-32a0-4008-ab69-3b5f9f0b0757 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:53.810021 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-11b942ea-32a0-4008-ab69-3b5f9f0b0757 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:53.810595 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-11b942ea-32a0-4008-ab69-3b5f9f0b0757 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:53.811047 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-11b942ea-32a0-4008-ab69-3b5f9f0b0757 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:53.814086 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-11b942ea-32a0-4008-ab69-3b5f9f0b0757 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:53.814562 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-11b942ea-32a0-4008-ab69-3b5f9f0b0757 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:53.814992 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-11b942ea-32a0-4008-ab69-3b5f9f0b0757 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:53.922906 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-11b942ea-32a0-4008-ab69-3b5f9f0b0757 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:53.927129 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=100 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:53.936965 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-11b942ea-32a0-4008-ab69-3b5f9f0b0757 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1346 microversion: 2.1 time: 0.146733 Sep 21 12:22:53.938037 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 138/275] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:53 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1346 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:22:53.968688 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-5b4558eb-03b6-490a-8a18-456125d52e27 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:53.976774 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-5b4558eb-03b6-490a-8a18-456125d52e27 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 200 len: 1314 microversion: 2.1 time: 0.219604 Sep 21 12:22:53.977556 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 138/276] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:53 2022] GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:54.962602 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-395970f8-eccb-4935-aaf1-5f46e8a2700c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:54.963230 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-395970f8-eccb-4935-aaf1-5f46e8a2700c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:54.978326 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-395970f8-eccb-4935-aaf1-5f46e8a2700c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:54.979872 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-395970f8-eccb-4935-aaf1-5f46e8a2700c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:54.980642 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-395970f8-eccb-4935-aaf1-5f46e8a2700c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:54.982012 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-395970f8-eccb-4935-aaf1-5f46e8a2700c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:54.983143 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-395970f8-eccb-4935-aaf1-5f46e8a2700c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:54.984227 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-395970f8-eccb-4935-aaf1-5f46e8a2700c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:55.001885 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-4ed4609b-9648-4ffa-a10b-960fb965a3fc tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:55.002508 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-4ed4609b-9648-4ffa-a10b-960fb965a3fc tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:55.005025 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:55.013504 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4ed4609b-9648-4ffa-a10b-960fb965a3fc tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:55.013992 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4ed4609b-9648-4ffa-a10b-960fb965a3fc tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:55.014451 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4ed4609b-9648-4ffa-a10b-960fb965a3fc tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:55.021770 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4ed4609b-9648-4ffa-a10b-960fb965a3fc tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:55.022246 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4ed4609b-9648-4ffa-a10b-960fb965a3fc tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:55.022827 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4ed4609b-9648-4ffa-a10b-960fb965a3fc tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:55.038812 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-395970f8-eccb-4935-aaf1-5f46e8a2700c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:55.044482 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-395970f8-eccb-4935-aaf1-5f46e8a2700c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:55.044982 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-395970f8-eccb-4935-aaf1-5f46e8a2700c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:55.045490 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.objects.instance [None req-395970f8-eccb-4935-aaf1-5f46e8a2700c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lazy-loading 'fault' on Instance uuid b11d666e-1c68-4889-b80e-a66aa10e05e9 {{(pid=120463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 12:22:55.313120 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-4ed4609b-9648-4ffa-a10b-960fb965a3fc tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:55.322186 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-4ed4609b-9648-4ffa-a10b-960fb965a3fc tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 200 len: 1314 microversion: 2.1 time: 0.324496 Sep 21 12:22:55.323221 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 139/277] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:54 2022] GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:55.339138 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-f573aeee-af9f-4bba-abef-9374d0f1693e req-f87a55c9-d3c6-4d17-88ed-93f7d737cc88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93785b09-4e56-42e1-865e-99e8059e0ce2", "name": "network-vif-plugged", "status": "completed", "tag": "7e905c9f-4fc1-4edd-8baf-ae4b1a56d65d"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:22:55.360623 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-395970f8-eccb-4935-aaf1-5f46e8a2700c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab0433dd3864867b03c5dd6407aa388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d5d713723f4ea5a8d1e72627b80c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:55.360816 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-f573aeee-af9f-4bba-abef-9374d0f1693e req-f87a55c9-d3c6-4d17-88ed-93f7d737cc88 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:55.361293 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-f573aeee-af9f-4bba-abef-9374d0f1693e req-f87a55c9-d3c6-4d17-88ed-93f7d737cc88 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:55.361722 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-f573aeee-af9f-4bba-abef-9374d0f1693e req-f87a55c9-d3c6-4d17-88ed-93f7d737cc88 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:55.370660 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-395970f8-eccb-4935-aaf1-5f46e8a2700c tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 200 len: 1305 microversion: 2.1 time: 0.412346 Sep 21 12:22:55.373825 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 139/278] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:54 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 1305 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:55.388311 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-f573aeee-af9f-4bba-abef-9374d0f1693e req-f87a55c9-d3c6-4d17-88ed-93f7d737cc88 service nova] Creating event network-vif-plugged:7e905c9f-4fc1-4edd-8baf-ae4b1a56d65d for instance 93785b09-4e56-42e1-865e-99e8059e0ce2 on hv-cinder-85867 Sep 21 12:22:55.395833 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-f573aeee-af9f-4bba-abef-9374d0f1693e req-f87a55c9-d3c6-4d17-88ed-93f7d737cc88 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071410 Sep 21 12:22:55.396735 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 140/279] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:22:56.351677 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-d816c2b9-93f2-44c7-a7c3-e6d24d17c368 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:56.352349 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-d816c2b9-93f2-44c7-a7c3-e6d24d17c368 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:56.359452 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d816c2b9-93f2-44c7-a7c3-e6d24d17c368 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:56.359970 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d816c2b9-93f2-44c7-a7c3-e6d24d17c368 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:56.360409 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d816c2b9-93f2-44c7-a7c3-e6d24d17c368 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:56.361102 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d816c2b9-93f2-44c7-a7c3-e6d24d17c368 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:56.361555 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d816c2b9-93f2-44c7-a7c3-e6d24d17c368 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:56.362010 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d816c2b9-93f2-44c7-a7c3-e6d24d17c368 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:56.394827 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-27dc7ae4-195e-4dd6-8522-58cd9abd4275 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:56.395656 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-27dc7ae4-195e-4dd6-8522-58cd9abd4275 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:56.401791 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-27dc7ae4-195e-4dd6-8522-58cd9abd4275 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:56.402560 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-27dc7ae4-195e-4dd6-8522-58cd9abd4275 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:56.402975 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-27dc7ae4-195e-4dd6-8522-58cd9abd4275 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:56.403922 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-27dc7ae4-195e-4dd6-8522-58cd9abd4275 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:56.404384 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-27dc7ae4-195e-4dd6-8522-58cd9abd4275 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:56.404815 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-27dc7ae4-195e-4dd6-8522-58cd9abd4275 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:56.419974 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.wsgi [None req-27dc7ae4-195e-4dd6-8522-58cd9abd4275 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] HTTP exception thrown: Instance b11d666e-1c68-4889-b80e-a66aa10e05e9 could not be found. Sep 21 12:22:56.425470 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-27dc7ae4-195e-4dd6-8522-58cd9abd4275 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Request method failure captured: Sep 21 12:22:56.425470 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: request: GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 HTTP/1.1 Sep 21 12:22:56.425470 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept: application/json Sep 21 12:22:56.425470 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept-Encoding: identity Sep 21 12:22:56.425470 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Connection: close Sep 21 12:22:56.425470 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Length: 0 Sep 21 12:22:56.425470 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Type: application/json Sep 21 12:22:56.425470 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Host: 10.222.0.71 Sep 21 12:22:56.425470 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Openstack-System-Scope: None Sep 21 12:22:56.425470 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: User-Agent: python-urllib3/1.26.12 Sep 21 12:22:56.425470 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Auth-Token: gAAAAABjKwGnoB1gvDOVnrNzXNSgIkT2HpNaGEBhtFXinJjkS_EYWn_5SZuEPdO23uPneiWooxMSvvjNOb4xS9jQr41Fk4ekPxeKEuIMjKMToJUgyokkcredxI2HVwQWz9yE5vHLkd0kAmfcsPFJNHCx8Ez3oudq651C6FDof6jwpcl2446FPR8 Sep 21 12:22:56.425470 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Id: None Sep 21 12:22:56.425470 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Name: None Sep 21 12:22:56.425470 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Identity-Status: Confirmed Sep 21 12:22:56.425470 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Is-Admin-Project: True Sep 21 12:22:56.425470 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Id: default Sep 21 12:22:56.425470 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Name: Default Sep 21 12:22:56.425470 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Id: 74d5d713723f4ea5a8d1e72627b80c47 Sep 21 12:22:56.425470 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Name: tempest-DeleteServersTestJSON-2023134199 Sep 21 12:22:56.425470 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Role: reader,member Sep 21 12:22:56.425470 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Roles: reader,member Sep 21 12:22:56.426753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/74d5d713723f4ea5a8d1e72627b80c47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/74d5d713723f4ea5a8d1e72627b80c47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_74d5d713723f4ea5a8d1e72627b80c47", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/74d5d713723f4ea5a8d1e72627b80c47"}]}] Sep 21 12:22:56.426753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant: tempest-DeleteServersTestJSON-2023134199 Sep 21 12:22:56.426753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Id: 74d5d713723f4ea5a8d1e72627b80c47 Sep 21 12:22:56.426753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Name: tempest-DeleteServersTestJSON-2023134199 Sep 21 12:22:56.426753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User: tempest-DeleteServersTestJSON-2023134199-project Sep 21 12:22:56.426753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Id: default Sep 21 12:22:56.426753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Name: Default Sep 21 12:22:56.426753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Id: 2ab0433dd3864867b03c5dd6407aa388 Sep 21 12:22:56.426753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Name: tempest-DeleteServersTestJSON-2023134199-project Sep 21 12:22:56.426753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: method: > Sep 21 12:22:56.426753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: exception: Instance b11d666e-1c68-4889-b80e-a66aa10e05e9 could not be found. Sep 21 12:22:56.426753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: action_args: {'id': 'b11d666e-1c68-4889-b80e-a66aa10e05e9'} Sep 21 12:22:56.427435 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:22:56.427435 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:22:56.427435 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:22:56.427435 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:22:56.427435 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:22:56.427435 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:22:56.427435 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:22:56.427435 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:22:56.427435 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:22:56.427435 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:22:56.427435 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b11d666e-1c68-4889-b80e-a66aa10e05e9 could not be found. Sep 21 12:22:56.427435 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:22:56.427435 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:22:56.427435 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:22:56.427435 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:22:56.427435 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:22:56.427435 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:22:56.427435 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:22:56.427435 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:22:56.427435 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:22:56.428602 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:22:56.428602 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 12:22:56.428602 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 12:22:56.428602 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:22:56.428602 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:22:56.428602 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:22:56.428602 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:22:56.428602 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b11d666e-1c68-4889-b80e-a66aa10e05e9 could not be found. Sep 21 12:22:56.428602 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:22:56.428602 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:22:56.428602 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:22:56.428602 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:22:56.428602 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:22:56.428602 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:22:56.428602 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:22:56.428602 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:22:56.428602 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b11d666e-1c68-4889-b80e-a66aa10e05e9 could not be found. Sep 21 12:22:56.428602 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:22:56.433503 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-27dc7ae4-195e-4dd6-8522-58cd9abd4275 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Returning 404 to user: Instance b11d666e-1c68-4889-b80e-a66aa10e05e9 could not be found. {{(pid=120462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:22:56.434523 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-27dc7ae4-195e-4dd6-8522-58cd9abd4275 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 404 len: 111 microversion: 2.1 time: 0.043820 Sep 21 12:22:56.434959 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 141/280] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:56 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 21 12:22:56.520130 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-d816c2b9-93f2-44c7-a7c3-e6d24d17c368 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:56.530734 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-d816c2b9-93f2-44c7-a7c3-e6d24d17c368 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 200 len: 1314 microversion: 2.1 time: 0.182421 Sep 21 12:22:56.534772 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 140/281] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:56 2022] GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:56.575339 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-8dec1ce5-c4d4-475b-bbc1-25b2f7167d53 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:56.577561 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-8dec1ce5-c4d4-475b-bbc1-25b2f7167d53 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:56.594182 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8dec1ce5-c4d4-475b-bbc1-25b2f7167d53 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:56.594769 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8dec1ce5-c4d4-475b-bbc1-25b2f7167d53 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:56.595196 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8dec1ce5-c4d4-475b-bbc1-25b2f7167d53 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:56.596126 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8dec1ce5-c4d4-475b-bbc1-25b2f7167d53 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:56.596729 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8dec1ce5-c4d4-475b-bbc1-25b2f7167d53 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:56.597301 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8dec1ce5-c4d4-475b-bbc1-25b2f7167d53 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:56.618051 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.wsgi [None req-8dec1ce5-c4d4-475b-bbc1-25b2f7167d53 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] HTTP exception thrown: Instance b11d666e-1c68-4889-b80e-a66aa10e05e9 could not be found. Sep 21 12:22:56.619717 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-8dec1ce5-c4d4-475b-bbc1-25b2f7167d53 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Request method failure captured: Sep 21 12:22:56.619717 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: request: GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9/os-volume_attachments HTTP/1.1 Sep 21 12:22:56.619717 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept: application/json Sep 21 12:22:56.619717 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept-Encoding: identity Sep 21 12:22:56.619717 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Connection: close Sep 21 12:22:56.619717 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Length: 0 Sep 21 12:22:56.619717 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Type: application/json Sep 21 12:22:56.619717 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Host: 10.222.0.71 Sep 21 12:22:56.619717 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Openstack-System-Scope: None Sep 21 12:22:56.619717 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: User-Agent: python-urllib3/1.26.12 Sep 21 12:22:56.619717 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Auth-Token: gAAAAABjKwGnoB1gvDOVnrNzXNSgIkT2HpNaGEBhtFXinJjkS_EYWn_5SZuEPdO23uPneiWooxMSvvjNOb4xS9jQr41Fk4ekPxeKEuIMjKMToJUgyokkcredxI2HVwQWz9yE5vHLkd0kAmfcsPFJNHCx8Ez3oudq651C6FDof6jwpcl2446FPR8 Sep 21 12:22:56.619717 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Id: None Sep 21 12:22:56.619717 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Name: None Sep 21 12:22:56.619717 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Identity-Status: Confirmed Sep 21 12:22:56.619717 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Is-Admin-Project: True Sep 21 12:22:56.619717 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Id: default Sep 21 12:22:56.619717 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Name: Default Sep 21 12:22:56.619717 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Id: 74d5d713723f4ea5a8d1e72627b80c47 Sep 21 12:22:56.619717 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Name: tempest-DeleteServersTestJSON-2023134199 Sep 21 12:22:56.619717 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Role: reader,member Sep 21 12:22:56.619717 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Roles: reader,member Sep 21 12:22:56.621342 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/74d5d713723f4ea5a8d1e72627b80c47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/74d5d713723f4ea5a8d1e72627b80c47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_74d5d713723f4ea5a8d1e72627b80c47", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/74d5d713723f4ea5a8d1e72627b80c47"}]}] Sep 21 12:22:56.621342 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant: tempest-DeleteServersTestJSON-2023134199 Sep 21 12:22:56.621342 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Id: 74d5d713723f4ea5a8d1e72627b80c47 Sep 21 12:22:56.621342 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Name: tempest-DeleteServersTestJSON-2023134199 Sep 21 12:22:56.621342 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User: tempest-DeleteServersTestJSON-2023134199-project Sep 21 12:22:56.621342 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Id: default Sep 21 12:22:56.621342 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Name: Default Sep 21 12:22:56.621342 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Id: 2ab0433dd3864867b03c5dd6407aa388 Sep 21 12:22:56.621342 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Name: tempest-DeleteServersTestJSON-2023134199-project Sep 21 12:22:56.621342 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: method: > Sep 21 12:22:56.621342 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: exception: Instance b11d666e-1c68-4889-b80e-a66aa10e05e9 could not be found. Sep 21 12:22:56.621342 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: action_args: {'server_id': 'b11d666e-1c68-4889-b80e-a66aa10e05e9'} Sep 21 12:22:56.622026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:22:56.622026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:22:56.622026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:22:56.622026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:22:56.622026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:22:56.622026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:22:56.622026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:22:56.622026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:22:56.622026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:22:56.622026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:22:56.622026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b11d666e-1c68-4889-b80e-a66aa10e05e9 could not be found. Sep 21 12:22:56.622026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:22:56.622026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:22:56.622026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:22:56.622026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:22:56.622026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:22:56.622026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:22:56.622026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:22:56.622026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:22:56.622026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:22:56.623111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:22:56.623111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 21 12:22:56.623111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 21 12:22:56.623111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 21 12:22:56.623111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 21 12:22:56.623111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 21 12:22:56.623111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 21 12:22:56.623111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:22:56.623111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:22:56.623111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b11d666e-1c68-4889-b80e-a66aa10e05e9 could not be found. Sep 21 12:22:56.623111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:22:56.623111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:22:56.623111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:22:56.623111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:22:56.623111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:22:56.623111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:22:56.623111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:22:56.623111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:22:56.623111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b11d666e-1c68-4889-b80e-a66aa10e05e9 could not be found. Sep 21 12:22:56.623111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:22:56.624349 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-8dec1ce5-c4d4-475b-bbc1-25b2f7167d53 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Returning 404 to user: Instance b11d666e-1c68-4889-b80e-a66aa10e05e9 could not be found. {{(pid=120462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:22:56.630325 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-8dec1ce5-c4d4-475b-bbc1-25b2f7167d53 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.059082 Sep 21 12:22:56.630897 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 142/282] 10.222.0.71 () {58 vars in 1302 bytes} [Wed Sep 21 12:22:56 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9/os-volume_attachments => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:22:57.556234 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-849caea8-8773-498c-85f3-38ab11a6a2bc tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:57.557492 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-849caea8-8773-498c-85f3-38ab11a6a2bc tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:57.564715 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-849caea8-8773-498c-85f3-38ab11a6a2bc tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:57.565581 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-849caea8-8773-498c-85f3-38ab11a6a2bc tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:57.566247 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-849caea8-8773-498c-85f3-38ab11a6a2bc tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:57.566964 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-849caea8-8773-498c-85f3-38ab11a6a2bc tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:57.567476 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-849caea8-8773-498c-85f3-38ab11a6a2bc tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:57.568105 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-849caea8-8773-498c-85f3-38ab11a6a2bc tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:57.726173 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-849caea8-8773-498c-85f3-38ab11a6a2bc tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:57.734295 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-849caea8-8773-498c-85f3-38ab11a6a2bc tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 200 len: 1314 microversion: 2.1 time: 0.182071 Sep 21 12:22:57.735255 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 141/283] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:57 2022] GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:22:57.861543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-51b189c5-6744-4215-9770-b971b45c5ef7 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:57.862075 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-51b189c5-6744-4215-9770-b971b45c5ef7 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:57.868648 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-51b189c5-6744-4215-9770-b971b45c5ef7 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:57.869491 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-51b189c5-6744-4215-9770-b971b45c5ef7 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:57.870081 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-51b189c5-6744-4215-9770-b971b45c5ef7 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:57.870938 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-51b189c5-6744-4215-9770-b971b45c5ef7 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:57.871783 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-51b189c5-6744-4215-9770-b971b45c5ef7 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:57.872513 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-51b189c5-6744-4215-9770-b971b45c5ef7 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:57.896400 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.wsgi [None req-51b189c5-6744-4215-9770-b971b45c5ef7 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] HTTP exception thrown: Instance b11d666e-1c68-4889-b80e-a66aa10e05e9 could not be found. Sep 21 12:22:57.896840 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-51b189c5-6744-4215-9770-b971b45c5ef7 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Request method failure captured: Sep 21 12:22:57.896840 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: request: DELETE /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 HTTP/1.1 Sep 21 12:22:57.896840 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept: application/json Sep 21 12:22:57.896840 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept-Encoding: identity Sep 21 12:22:57.896840 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Connection: close Sep 21 12:22:57.896840 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Length: 0 Sep 21 12:22:57.896840 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Type: application/json Sep 21 12:22:57.896840 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Host: 10.222.0.71 Sep 21 12:22:57.896840 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Openstack-System-Scope: None Sep 21 12:22:57.896840 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: User-Agent: python-urllib3/1.26.12 Sep 21 12:22:57.896840 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Auth-Token: gAAAAABjKwGnoB1gvDOVnrNzXNSgIkT2HpNaGEBhtFXinJjkS_EYWn_5SZuEPdO23uPneiWooxMSvvjNOb4xS9jQr41Fk4ekPxeKEuIMjKMToJUgyokkcredxI2HVwQWz9yE5vHLkd0kAmfcsPFJNHCx8Ez3oudq651C6FDof6jwpcl2446FPR8 Sep 21 12:22:57.896840 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Id: None Sep 21 12:22:57.896840 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Name: None Sep 21 12:22:57.896840 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Identity-Status: Confirmed Sep 21 12:22:57.896840 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Is-Admin-Project: True Sep 21 12:22:57.896840 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Id: default Sep 21 12:22:57.896840 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Name: Default Sep 21 12:22:57.896840 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Id: 74d5d713723f4ea5a8d1e72627b80c47 Sep 21 12:22:57.896840 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Name: tempest-DeleteServersTestJSON-2023134199 Sep 21 12:22:57.896840 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Role: reader,member Sep 21 12:22:57.896840 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Roles: reader,member Sep 21 12:22:57.898010 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/74d5d713723f4ea5a8d1e72627b80c47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/74d5d713723f4ea5a8d1e72627b80c47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_74d5d713723f4ea5a8d1e72627b80c47", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/74d5d713723f4ea5a8d1e72627b80c47"}]}] Sep 21 12:22:57.898010 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant: tempest-DeleteServersTestJSON-2023134199 Sep 21 12:22:57.898010 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Id: 74d5d713723f4ea5a8d1e72627b80c47 Sep 21 12:22:57.898010 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Name: tempest-DeleteServersTestJSON-2023134199 Sep 21 12:22:57.898010 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User: tempest-DeleteServersTestJSON-2023134199-project Sep 21 12:22:57.898010 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Id: default Sep 21 12:22:57.898010 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Name: Default Sep 21 12:22:57.898010 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Id: 2ab0433dd3864867b03c5dd6407aa388 Sep 21 12:22:57.898010 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Name: tempest-DeleteServersTestJSON-2023134199-project Sep 21 12:22:57.898010 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: method: > Sep 21 12:22:57.898010 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: exception: Instance b11d666e-1c68-4889-b80e-a66aa10e05e9 could not be found. Sep 21 12:22:57.898010 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: action_args: {'id': 'b11d666e-1c68-4889-b80e-a66aa10e05e9'} Sep 21 12:22:57.898724 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:22:57.898724 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:22:57.898724 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:22:57.898724 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:22:57.898724 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:22:57.898724 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:22:57.898724 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:22:57.898724 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:22:57.898724 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:22:57.898724 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:22:57.898724 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b11d666e-1c68-4889-b80e-a66aa10e05e9 could not be found. Sep 21 12:22:57.898724 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:22:57.898724 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:22:57.898724 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:22:57.898724 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:22:57.898724 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:22:57.898724 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:22:57.898724 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:22:57.898724 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:22:57.898724 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:22:57.899818 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:22:57.899818 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 21 12:22:57.899818 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 21 12:22:57.899818 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 21 12:22:57.899818 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 21 12:22:57.899818 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:22:57.899818 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:22:57.899818 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:22:57.899818 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:22:57.899818 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b11d666e-1c68-4889-b80e-a66aa10e05e9 could not be found. Sep 21 12:22:57.899818 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:22:57.899818 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:22:57.899818 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:22:57.899818 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:22:57.899818 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:22:57.899818 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:22:57.899818 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:22:57.899818 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:22:57.899818 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b11d666e-1c68-4889-b80e-a66aa10e05e9 could not be found. Sep 21 12:22:57.899818 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:22:57.901308 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-51b189c5-6744-4215-9770-b971b45c5ef7 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Returning 404 to user: Instance b11d666e-1c68-4889-b80e-a66aa10e05e9 could not be found. {{(pid=120462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:22:57.901308 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-51b189c5-6744-4215-9770-b971b45c5ef7 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "DELETE /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 404 len: 111 microversion: 2.1 time: 0.040827 Sep 21 12:22:57.901308 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 143/284] 10.222.0.71 () {58 vars in 1239 bytes} [Wed Sep 21 12:22:57 2022] DELETE /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:22:57.909838 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-5f845531-4996-4a58-8292-d78bed8c7d39 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:57.910576 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-5f845531-4996-4a58-8292-d78bed8c7d39 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] [instance: b11d666e-1c68-4889-b80e-a66aa10e05e9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:57.916664 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5f845531-4996-4a58-8292-d78bed8c7d39 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:57.917158 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5f845531-4996-4a58-8292-d78bed8c7d39 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:57.917598 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5f845531-4996-4a58-8292-d78bed8c7d39 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:57.918300 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5f845531-4996-4a58-8292-d78bed8c7d39 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:57.918757 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5f845531-4996-4a58-8292-d78bed8c7d39 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:57.919188 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5f845531-4996-4a58-8292-d78bed8c7d39 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:57.932704 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.wsgi [None req-5f845531-4996-4a58-8292-d78bed8c7d39 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] HTTP exception thrown: Instance b11d666e-1c68-4889-b80e-a66aa10e05e9 could not be found. Sep 21 12:22:57.938055 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-5f845531-4996-4a58-8292-d78bed8c7d39 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Request method failure captured: Sep 21 12:22:57.938055 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: request: GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 HTTP/1.1 Sep 21 12:22:57.938055 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept: application/json Sep 21 12:22:57.938055 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept-Encoding: identity Sep 21 12:22:57.938055 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Connection: close Sep 21 12:22:57.938055 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Length: 0 Sep 21 12:22:57.938055 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Type: application/json Sep 21 12:22:57.938055 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Host: 10.222.0.71 Sep 21 12:22:57.938055 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Openstack-System-Scope: None Sep 21 12:22:57.938055 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: User-Agent: python-urllib3/1.26.12 Sep 21 12:22:57.938055 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Auth-Token: gAAAAABjKwGnoB1gvDOVnrNzXNSgIkT2HpNaGEBhtFXinJjkS_EYWn_5SZuEPdO23uPneiWooxMSvvjNOb4xS9jQr41Fk4ekPxeKEuIMjKMToJUgyokkcredxI2HVwQWz9yE5vHLkd0kAmfcsPFJNHCx8Ez3oudq651C6FDof6jwpcl2446FPR8 Sep 21 12:22:57.938055 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Id: None Sep 21 12:22:57.938055 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Name: None Sep 21 12:22:57.938055 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Identity-Status: Confirmed Sep 21 12:22:57.938055 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Is-Admin-Project: True Sep 21 12:22:57.938055 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Id: default Sep 21 12:22:57.938055 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Name: Default Sep 21 12:22:57.938055 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Id: 74d5d713723f4ea5a8d1e72627b80c47 Sep 21 12:22:57.938055 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Name: tempest-DeleteServersTestJSON-2023134199 Sep 21 12:22:57.938055 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Role: reader,member Sep 21 12:22:57.938055 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Roles: reader,member Sep 21 12:22:57.939506 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/74d5d713723f4ea5a8d1e72627b80c47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/74d5d713723f4ea5a8d1e72627b80c47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_74d5d713723f4ea5a8d1e72627b80c47", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/74d5d713723f4ea5a8d1e72627b80c47"}]}] Sep 21 12:22:57.939506 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant: tempest-DeleteServersTestJSON-2023134199 Sep 21 12:22:57.939506 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Id: 74d5d713723f4ea5a8d1e72627b80c47 Sep 21 12:22:57.939506 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Name: tempest-DeleteServersTestJSON-2023134199 Sep 21 12:22:57.939506 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User: tempest-DeleteServersTestJSON-2023134199-project Sep 21 12:22:57.939506 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Id: default Sep 21 12:22:57.939506 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Name: Default Sep 21 12:22:57.939506 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Id: 2ab0433dd3864867b03c5dd6407aa388 Sep 21 12:22:57.939506 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Name: tempest-DeleteServersTestJSON-2023134199-project Sep 21 12:22:57.939506 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: method: > Sep 21 12:22:57.939506 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: exception: Instance b11d666e-1c68-4889-b80e-a66aa10e05e9 could not be found. Sep 21 12:22:57.939506 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: action_args: {'id': 'b11d666e-1c68-4889-b80e-a66aa10e05e9'} Sep 21 12:22:57.944066 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:22:57.944066 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:22:57.944066 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:22:57.944066 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:22:57.944066 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:22:57.944066 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:22:57.944066 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:22:57.944066 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:22:57.944066 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:22:57.944066 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:22:57.944066 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b11d666e-1c68-4889-b80e-a66aa10e05e9 could not be found. Sep 21 12:22:57.944066 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:22:57.944066 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:22:57.944066 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:22:57.944066 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:22:57.944066 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:22:57.944066 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:22:57.944066 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:22:57.944066 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:22:57.944066 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:22:57.945441 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:22:57.945441 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 12:22:57.945441 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 12:22:57.945441 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:22:57.945441 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:22:57.945441 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:22:57.945441 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:22:57.945441 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b11d666e-1c68-4889-b80e-a66aa10e05e9 could not be found. Sep 21 12:22:57.945441 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:22:57.945441 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:22:57.945441 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:22:57.945441 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:22:57.945441 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:22:57.945441 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:22:57.945441 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:22:57.945441 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:22:57.945441 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b11d666e-1c68-4889-b80e-a66aa10e05e9 could not be found. Sep 21 12:22:57.945441 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:22:57.946588 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-5f845531-4996-4a58-8292-d78bed8c7d39 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] Returning 404 to user: Instance b11d666e-1c68-4889-b80e-a66aa10e05e9 could not be found. {{(pid=120463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:22:57.946588 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-5f845531-4996-4a58-8292-d78bed8c7d39 tempest-DeleteServersTestJSON-2023134199 tempest-DeleteServersTestJSON-2023134199-project] 10.222.0.71 "GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9" status: 404 len: 111 microversion: 2.1 time: 0.034163 Sep 21 12:22:57.946588 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 142/285] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:57 2022] GET /compute/v2.1/servers/b11d666e-1c68-4889-b80e-a66aa10e05e9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:22:58.758140 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-47ed9caf-29d6-4aea-b651-a15ccfcb5346 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:58.758754 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-47ed9caf-29d6-4aea-b651-a15ccfcb5346 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:58.767221 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-47ed9caf-29d6-4aea-b651-a15ccfcb5346 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:58.767718 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-47ed9caf-29d6-4aea-b651-a15ccfcb5346 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:58.768184 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-47ed9caf-29d6-4aea-b651-a15ccfcb5346 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:58.768896 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-47ed9caf-29d6-4aea-b651-a15ccfcb5346 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:58.769333 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-47ed9caf-29d6-4aea-b651-a15ccfcb5346 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:58.769757 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-47ed9caf-29d6-4aea-b651-a15ccfcb5346 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:58.919140 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-47ed9caf-29d6-4aea-b651-a15ccfcb5346 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:22:58.926978 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-47ed9caf-29d6-4aea-b651-a15ccfcb5346 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 200 len: 1499 microversion: 2.1 time: 0.172750 Sep 21 12:22:58.927781 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 144/286] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:58 2022] GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 1499 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:22:59.647923 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-56613f58-bd59-4e89-a57c-b7c4114b63f6 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:59.648636 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-56613f58-bd59-4e89-a57c-b7c4114b63f6 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:59.656600 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-56613f58-bd59-4e89-a57c-b7c4114b63f6 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:59.657215 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-56613f58-bd59-4e89-a57c-b7c4114b63f6 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:59.657747 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-56613f58-bd59-4e89-a57c-b7c4114b63f6 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:59.658562 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-56613f58-bd59-4e89-a57c-b7c4114b63f6 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:59.659119 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-56613f58-bd59-4e89-a57c-b7c4114b63f6 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:59.659640 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-56613f58-bd59-4e89-a57c-b7c4114b63f6 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:59.687941 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-56613f58-bd59-4e89-a57c-b7c4114b63f6 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Going to try to terminate instance {{(pid=120463) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 12:22:59.856909 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-56613f58-bd59-4e89-a57c-b7c4114b63f6 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "DELETE /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 204 len: 0 microversion: 2.1 time: 0.213081 Sep 21 12:22:59.858744 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 143/287] 10.222.0.71 () {58 vars in 1239 bytes} [Wed Sep 21 12:22:59 2022] DELETE /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 21 12:22:59.867094 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-1f254be4-3200-49cc-ba9e-8b76a436a090 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:22:59.867996 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-1f254be4-3200-49cc-ba9e-8b76a436a090 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:22:59.875902 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1f254be4-3200-49cc-ba9e-8b76a436a090 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:59.876738 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1f254be4-3200-49cc-ba9e-8b76a436a090 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:59.877350 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1f254be4-3200-49cc-ba9e-8b76a436a090 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:22:59.878328 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1f254be4-3200-49cc-ba9e-8b76a436a090 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:22:59.878978 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1f254be4-3200-49cc-ba9e-8b76a436a090 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:22:59.879628 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1f254be4-3200-49cc-ba9e-8b76a436a090 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:00.215541 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-1f254be4-3200-49cc-ba9e-8b76a436a090 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:00.231922 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-1f254be4-3200-49cc-ba9e-8b76a436a090 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 200 len: 1505 microversion: 2.1 time: 0.368582 Sep 21 12:23:00.233550 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 145/288] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:22:59 2022] GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 1505 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:01.259061 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-68e97f0a-0e6b-473f-9f66-92f0d8627c7a tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:01.260316 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-68e97f0a-0e6b-473f-9f66-92f0d8627c7a tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:01.267879 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-68e97f0a-0e6b-473f-9f66-92f0d8627c7a tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:01.268694 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-68e97f0a-0e6b-473f-9f66-92f0d8627c7a tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:01.269328 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-68e97f0a-0e6b-473f-9f66-92f0d8627c7a tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:01.270043 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-68e97f0a-0e6b-473f-9f66-92f0d8627c7a tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:01.270504 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-68e97f0a-0e6b-473f-9f66-92f0d8627c7a tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:01.270932 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-68e97f0a-0e6b-473f-9f66-92f0d8627c7a tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:01.830312 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-68e97f0a-0e6b-473f-9f66-92f0d8627c7a tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:01.845039 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-68e97f0a-0e6b-473f-9f66-92f0d8627c7a tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 200 len: 1505 microversion: 2.1 time: 0.589014 Sep 21 12:23:01.849934 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 144/289] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:01 2022] GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 1505 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:02.716639 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-f9195b64-d6c9-4400-b6a6-807fdec5d295 req-8b443e36-6667-4c1c-850b-6f623f5cb841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93785b09-4e56-42e1-865e-99e8059e0ce2", "name": "network-vif-deleted", "tag": "7e905c9f-4fc1-4edd-8baf-ae4b1a56d65d"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:23:02.735682 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-f9195b64-d6c9-4400-b6a6-807fdec5d295 req-8b443e36-6667-4c1c-850b-6f623f5cb841 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:02.736203 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-f9195b64-d6c9-4400-b6a6-807fdec5d295 req-8b443e36-6667-4c1c-850b-6f623f5cb841 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:02.740481 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-f9195b64-d6c9-4400-b6a6-807fdec5d295 req-8b443e36-6667-4c1c-850b-6f623f5cb841 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:02.761352 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-f9195b64-d6c9-4400-b6a6-807fdec5d295 req-8b443e36-6667-4c1c-850b-6f623f5cb841 service nova] Creating event network-vif-deleted:7e905c9f-4fc1-4edd-8baf-ae4b1a56d65d for instance 93785b09-4e56-42e1-865e-99e8059e0ce2 on hv-cinder-85867 Sep 21 12:23:02.768440 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-f9195b64-d6c9-4400-b6a6-807fdec5d295 req-8b443e36-6667-4c1c-850b-6f623f5cb841 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062444 Sep 21 12:23:02.769468 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 146/290] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:23:02.875640 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-d46a3f1e-edd9-4ba7-bba8-ab9939f376fa tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:02.877052 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-d46a3f1e-edd9-4ba7-bba8-ab9939f376fa tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:02.883940 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d46a3f1e-edd9-4ba7-bba8-ab9939f376fa tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:02.884714 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d46a3f1e-edd9-4ba7-bba8-ab9939f376fa tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:02.885396 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d46a3f1e-edd9-4ba7-bba8-ab9939f376fa tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:02.886306 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d46a3f1e-edd9-4ba7-bba8-ab9939f376fa tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:02.887157 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d46a3f1e-edd9-4ba7-bba8-ab9939f376fa tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:02.887874 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d46a3f1e-edd9-4ba7-bba8-ab9939f376fa tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:02.938576 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d46a3f1e-edd9-4ba7-bba8-ab9939f376fa tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:02.939385 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d46a3f1e-edd9-4ba7-bba8-ab9939f376fa tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:02.940117 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d46a3f1e-edd9-4ba7-bba8-ab9939f376fa tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:02.940774 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.objects.instance [None req-d46a3f1e-edd9-4ba7-bba8-ab9939f376fa tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lazy-loading 'fault' on Instance uuid 93785b09-4e56-42e1-865e-99e8059e0ce2 {{(pid=120463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 12:23:03.022981 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-d46a3f1e-edd9-4ba7-bba8-ab9939f376fa tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:03.035293 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-d46a3f1e-edd9-4ba7-bba8-ab9939f376fa tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 200 len: 1304 microversion: 2.1 time: 0.162842 Sep 21 12:23:03.035916 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 145/291] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:02 2022] GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 1304 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:04.058382 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-4a26c47b-da0f-499a-a01c-5fc2e421ecce tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:04.059088 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-4a26c47b-da0f-499a-a01c-5fc2e421ecce tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 93785b09-4e56-42e1-865e-99e8059e0ce2] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:04.065749 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4a26c47b-da0f-499a-a01c-5fc2e421ecce tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:04.066539 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4a26c47b-da0f-499a-a01c-5fc2e421ecce tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:04.067126 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4a26c47b-da0f-499a-a01c-5fc2e421ecce tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:04.068030 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4a26c47b-da0f-499a-a01c-5fc2e421ecce tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:04.068494 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4a26c47b-da0f-499a-a01c-5fc2e421ecce tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:04.068936 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4a26c47b-da0f-499a-a01c-5fc2e421ecce tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:04.087068 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.wsgi [None req-4a26c47b-da0f-499a-a01c-5fc2e421ecce tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] HTTP exception thrown: Instance 93785b09-4e56-42e1-865e-99e8059e0ce2 could not be found. Sep 21 12:23:04.088770 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-4a26c47b-da0f-499a-a01c-5fc2e421ecce tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Request method failure captured: Sep 21 12:23:04.088770 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: request: GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 HTTP/1.1 Sep 21 12:23:04.088770 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept: application/json Sep 21 12:23:04.088770 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept-Encoding: identity Sep 21 12:23:04.088770 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Connection: close Sep 21 12:23:04.088770 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Length: 0 Sep 21 12:23:04.088770 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Type: application/json Sep 21 12:23:04.088770 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Host: 10.222.0.71 Sep 21 12:23:04.088770 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Openstack-System-Scope: None Sep 21 12:23:04.088770 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: User-Agent: python-urllib3/1.26.12 Sep 21 12:23:04.088770 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Auth-Token: gAAAAABjKwH9twppulmCtTbtMjmE7h3nqj6bqBJj8Y5n4fLoSE0KEcgVI3YUK35-qfnWKNT5trWcVzUVffSwaSK8m_W9LUVNx104bz9GvQNefehbH-6TRkAEp93hv2v-8Uaf_F61wZgJhZkghZo9thJw1SYSGdyp1qWFkHgoUkxUtBHK7YWW2xo Sep 21 12:23:04.088770 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Id: None Sep 21 12:23:04.088770 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Name: None Sep 21 12:23:04.088770 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Identity-Status: Confirmed Sep 21 12:23:04.088770 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Is-Admin-Project: True Sep 21 12:23:04.088770 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Id: default Sep 21 12:23:04.088770 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Name: Default Sep 21 12:23:04.088770 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Id: c46922ef081642f6a3d8ad5d02e4155a Sep 21 12:23:04.088770 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Name: tempest-VolumesActionsTest-1210229347 Sep 21 12:23:04.088770 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Role: reader,member Sep 21 12:23:04.088770 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Roles: reader,member Sep 21 12:23:04.090310 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c46922ef081642f6a3d8ad5d02e4155a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c46922ef081642f6a3d8ad5d02e4155a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_c46922ef081642f6a3d8ad5d02e4155a", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/c46922ef081642f6a3d8ad5d02e4155a"}]}] Sep 21 12:23:04.090310 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant: tempest-VolumesActionsTest-1210229347 Sep 21 12:23:04.090310 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Id: c46922ef081642f6a3d8ad5d02e4155a Sep 21 12:23:04.090310 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Name: tempest-VolumesActionsTest-1210229347 Sep 21 12:23:04.090310 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User: tempest-VolumesActionsTest-1210229347-project Sep 21 12:23:04.090310 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Id: default Sep 21 12:23:04.090310 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Name: Default Sep 21 12:23:04.090310 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Id: 1f8e995175ec4c6583e1ad0c7fb902ab Sep 21 12:23:04.090310 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Name: tempest-VolumesActionsTest-1210229347-project Sep 21 12:23:04.090310 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: method: > Sep 21 12:23:04.090310 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: exception: Instance 93785b09-4e56-42e1-865e-99e8059e0ce2 could not be found. Sep 21 12:23:04.090310 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: action_args: {'id': '93785b09-4e56-42e1-865e-99e8059e0ce2'} Sep 21 12:23:04.091227 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:23:04.091227 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:23:04.091227 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:23:04.091227 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:23:04.091227 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:23:04.091227 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:23:04.091227 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:23:04.091227 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:23:04.091227 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:23:04.091227 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:23:04.091227 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93785b09-4e56-42e1-865e-99e8059e0ce2 could not be found. Sep 21 12:23:04.091227 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:23:04.091227 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:23:04.091227 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:23:04.091227 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:23:04.091227 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:23:04.091227 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:23:04.091227 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:23:04.091227 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:23:04.091227 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:23:04.093191 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:23:04.093191 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 12:23:04.093191 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 12:23:04.093191 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:23:04.093191 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:23:04.093191 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:23:04.093191 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:23:04.093191 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93785b09-4e56-42e1-865e-99e8059e0ce2 could not be found. Sep 21 12:23:04.093191 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:23:04.093191 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:23:04.093191 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:23:04.093191 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:23:04.093191 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:23:04.093191 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:23:04.093191 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:23:04.093191 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:23:04.093191 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93785b09-4e56-42e1-865e-99e8059e0ce2 could not be found. Sep 21 12:23:04.093191 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:23:04.095226 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-4a26c47b-da0f-499a-a01c-5fc2e421ecce tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Returning 404 to user: Instance 93785b09-4e56-42e1-865e-99e8059e0ce2 could not be found. {{(pid=120462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:23:04.096141 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-4a26c47b-da0f-499a-a01c-5fc2e421ecce tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2" status: 404 len: 111 microversion: 2.1 time: 0.042050 Sep 21 12:23:04.096710 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 147/292] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:04 2022] GET /compute/v2.1/servers/93785b09-4e56-42e1-865e-99e8059e0ce2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:23:04.205415 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-8c7737fd-ffd0-45a2-98f3-9176425dd327 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1774079860", "imageRef": "1e3a8d95-6338-499c-af91-e3d1345af950", "flavorRef": "452", "networks": [{"uuid": "81a38dde-d245-4a7c-b2e5-d5b018863549"}]}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:23:04.264579 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.network.neutron [None req-8c7737fd-ffd0-45a2-98f3-9176425dd327 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] validate_networks() for [('81a38dde-d245-4a7c-b2e5-d5b018863549', None, None, None, None, None)] {{(pid=120463) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 12:23:04.819006 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-8c7737fd-ffd0-45a2-98f3-9176425dd327 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Flavor limits 0:0:0 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 12:23:04.819477 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-8c7737fd-ffd0-45a2-98f3-9176425dd327 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Image limits 0:0:0 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 12:23:04.820638 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-8c7737fd-ffd0-45a2-98f3-9176425dd327 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Flavor pref 0:0:0 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 12:23:04.820638 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-8c7737fd-ffd0-45a2-98f3-9176425dd327 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Image pref 0:0:0 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 12:23:04.820966 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-8c7737fd-ffd0-45a2-98f3-9176425dd327 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 12:23:04.830429 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8c7737fd-ffd0-45a2-98f3-9176425dd327 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:04.831172 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8c7737fd-ffd0-45a2-98f3-9176425dd327 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:04.831870 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8c7737fd-ffd0-45a2-98f3-9176425dd327 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:04.832602 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8c7737fd-ffd0-45a2-98f3-9176425dd327 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:04.833065 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8c7737fd-ffd0-45a2-98f3-9176425dd327 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:04.833494 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8c7737fd-ffd0-45a2-98f3-9176425dd327 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:04.850304 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.quota [None req-8c7737fd-ffd0-45a2-98f3-9176425dd327 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Getting quotas for project c46922ef081642f6a3d8ad5d02e4155a. Resources: {'instances', 'ram', 'cores'} {{(pid=120463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 12:23:04.854332 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.quota [None req-8c7737fd-ffd0-45a2-98f3-9176425dd327 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Getting quotas for user 1f8e995175ec4c6583e1ad0c7fb902ab and project c46922ef081642f6a3d8ad5d02e4155a. Resources: {'instances', 'ram', 'cores'} {{(pid=120463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 12:23:04.866903 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-8c7737fd-ffd0-45a2-98f3-9176425dd327 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Going to run 1 instances... {{(pid=120463) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 12:23:04.869499 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-8c7737fd-ffd0-45a2-98f3-9176425dd327 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e3a8d95-6338-499c-af91-e3d1345af950',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 12:23:04.922771 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-8c7737fd-ffd0-45a2-98f3-9176425dd327 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.722038 Sep 21 12:23:04.923775 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 146/293] 10.222.0.71 () {60 vars in 1147 bytes} [Wed Sep 21 12:23:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 21 12:23:04.946245 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-65c2f34e-5f74-4157-a8b8-1a669a25b7b7 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:04.947350 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-65c2f34e-5f74-4157-a8b8-1a669a25b7b7 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:05.148179 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-65c2f34e-5f74-4157-a8b8-1a669a25b7b7 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:05.157222 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-65c2f34e-5f74-4157-a8b8-1a669a25b7b7 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 200 len: 1214 microversion: 2.1 time: 0.224378 Sep 21 12:23:05.172465 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 148/294] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:04 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 1214 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:06.184167 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-a552f4c9-12fe-4d18-a377-bba070cc258c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:06.185971 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-a552f4c9-12fe-4d18-a377-bba070cc258c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:06.195233 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a552f4c9-12fe-4d18-a377-bba070cc258c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:06.196122 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a552f4c9-12fe-4d18-a377-bba070cc258c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:06.197290 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a552f4c9-12fe-4d18-a377-bba070cc258c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:06.199613 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a552f4c9-12fe-4d18-a377-bba070cc258c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:06.200345 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a552f4c9-12fe-4d18-a377-bba070cc258c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:06.200808 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a552f4c9-12fe-4d18-a377-bba070cc258c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:06.324640 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a552f4c9-12fe-4d18-a377-bba070cc258c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:06.337740 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-a552f4c9-12fe-4d18-a377-bba070cc258c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 200 len: 1266 microversion: 2.1 time: 0.156983 Sep 21 12:23:06.339294 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 147/295] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:06 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:07.362713 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-a5061b99-e127-459a-a531-2dd5c8f8cc90 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:07.363400 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-a5061b99-e127-459a-a531-2dd5c8f8cc90 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:07.369338 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a5061b99-e127-459a-a531-2dd5c8f8cc90 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:07.370542 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a5061b99-e127-459a-a531-2dd5c8f8cc90 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:07.371423 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a5061b99-e127-459a-a531-2dd5c8f8cc90 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:07.372175 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a5061b99-e127-459a-a531-2dd5c8f8cc90 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:07.372945 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a5061b99-e127-459a-a531-2dd5c8f8cc90 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:07.373401 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a5061b99-e127-459a-a531-2dd5c8f8cc90 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:07.495656 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-a5061b99-e127-459a-a531-2dd5c8f8cc90 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:07.513463 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-a5061b99-e127-459a-a531-2dd5c8f8cc90 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 200 len: 1272 microversion: 2.1 time: 0.148690 Sep 21 12:23:07.516043 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 149/296] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:07 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:08.541963 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-f58087a4-533f-4c2c-9262-e7a6b254610c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:08.544351 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-f58087a4-533f-4c2c-9262-e7a6b254610c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:08.553375 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f58087a4-533f-4c2c-9262-e7a6b254610c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:08.554170 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f58087a4-533f-4c2c-9262-e7a6b254610c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:08.571240 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f58087a4-533f-4c2c-9262-e7a6b254610c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:08.572453 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f58087a4-533f-4c2c-9262-e7a6b254610c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:08.573216 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f58087a4-533f-4c2c-9262-e7a6b254610c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:08.573865 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f58087a4-533f-4c2c-9262-e7a6b254610c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:08.843362 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-f58087a4-533f-4c2c-9262-e7a6b254610c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:08.862182 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-f58087a4-533f-4c2c-9262-e7a6b254610c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 200 len: 1314 microversion: 2.1 time: 0.324501 Sep 21 12:23:08.863157 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 148/297] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:08 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:09.133202 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-f9b6d6ac-0ce2-466c-9ee1-61029e0609f7 req-150594a8-34e5-457a-9200-a1acb0fdd646 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "309d01e5-d152-40c7-bbe0-db2292d5f103", "tag": "31c51ceb-171d-4706-b582-46630abdaa5b"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:23:09.169595 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-f9b6d6ac-0ce2-466c-9ee1-61029e0609f7 req-150594a8-34e5-457a-9200-a1acb0fdd646 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:09.170137 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-f9b6d6ac-0ce2-466c-9ee1-61029e0609f7 req-150594a8-34e5-457a-9200-a1acb0fdd646 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:09.170577 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-f9b6d6ac-0ce2-466c-9ee1-61029e0609f7 req-150594a8-34e5-457a-9200-a1acb0fdd646 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:09.208209 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-f9b6d6ac-0ce2-466c-9ee1-61029e0609f7 req-150594a8-34e5-457a-9200-a1acb0fdd646 service nova] Creating event network-changed:31c51ceb-171d-4706-b582-46630abdaa5b for instance 309d01e5-d152-40c7-bbe0-db2292d5f103 on hv-cinder-85867 Sep 21 12:23:09.231461 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-f9b6d6ac-0ce2-466c-9ee1-61029e0609f7 req-150594a8-34e5-457a-9200-a1acb0fdd646 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111167 Sep 21 12:23:09.232758 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 150/298] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:23:09.904368 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-a7eb7f12-32d9-4334-8886-218a35eaa34a tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:09.905146 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-a7eb7f12-32d9-4334-8886-218a35eaa34a tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:09.919556 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a7eb7f12-32d9-4334-8886-218a35eaa34a tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:09.920214 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a7eb7f12-32d9-4334-8886-218a35eaa34a tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:09.920998 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a7eb7f12-32d9-4334-8886-218a35eaa34a tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:09.921716 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a7eb7f12-32d9-4334-8886-218a35eaa34a tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:09.922173 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a7eb7f12-32d9-4334-8886-218a35eaa34a tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:09.924335 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a7eb7f12-32d9-4334-8886-218a35eaa34a tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:10.333457 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a7eb7f12-32d9-4334-8886-218a35eaa34a tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:10.364032 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-a7eb7f12-32d9-4334-8886-218a35eaa34a tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 200 len: 1314 microversion: 2.1 time: 0.462770 Sep 21 12:23:10.368337 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 149/299] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:09 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:11.002539 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-05a8e51d-d0b3-44ed-bb66-e8356768c7a1 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1518866859", "imageRef": "1e3a8d95-6338-499c-af91-e3d1345af950", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:23:11.076759 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.network.neutron [None req-05a8e51d-d0b3-44ed-bb66-e8356768c7a1 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] validate_networks() for [('46771c4a-a4e0-44e3-b0ad-6700b1914d9d', None, None, None, None, None)] {{(pid=120462) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 12:23:11.393116 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-63a8c163-aae3-41b9-8ec5-c1cb3e8d8e14 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:11.393818 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-63a8c163-aae3-41b9-8ec5-c1cb3e8d8e14 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:11.410200 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-63a8c163-aae3-41b9-8ec5-c1cb3e8d8e14 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:11.410695 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-63a8c163-aae3-41b9-8ec5-c1cb3e8d8e14 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:11.423803 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-63a8c163-aae3-41b9-8ec5-c1cb3e8d8e14 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:11.424841 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-63a8c163-aae3-41b9-8ec5-c1cb3e8d8e14 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:11.425346 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-63a8c163-aae3-41b9-8ec5-c1cb3e8d8e14 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:11.425985 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-63a8c163-aae3-41b9-8ec5-c1cb3e8d8e14 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:11.630925 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-05a8e51d-d0b3-44ed-bb66-e8356768c7a1 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Flavor limits 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 12:23:11.631997 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-05a8e51d-d0b3-44ed-bb66-e8356768c7a1 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Image limits 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 12:23:11.632101 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-05a8e51d-d0b3-44ed-bb66-e8356768c7a1 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Flavor pref 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 12:23:11.632460 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-05a8e51d-d0b3-44ed-bb66-e8356768c7a1 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Image pref 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 12:23:11.632876 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-05a8e51d-d0b3-44ed-bb66-e8356768c7a1 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 12:23:11.643574 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-05a8e51d-d0b3-44ed-bb66-e8356768c7a1 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:11.644543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-05a8e51d-d0b3-44ed-bb66-e8356768c7a1 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:11.646792 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-05a8e51d-d0b3-44ed-bb66-e8356768c7a1 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:11.648090 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-05a8e51d-d0b3-44ed-bb66-e8356768c7a1 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:11.648772 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-05a8e51d-d0b3-44ed-bb66-e8356768c7a1 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:11.649423 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-05a8e51d-d0b3-44ed-bb66-e8356768c7a1 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:11.673287 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-05a8e51d-d0b3-44ed-bb66-e8356768c7a1 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Getting quotas for project d3bd02ae79fd4edb9886b1b4ef3d761a. Resources: {'instances', 'ram', 'cores'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 12:23:11.679487 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-05a8e51d-d0b3-44ed-bb66-e8356768c7a1 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Getting quotas for user 0fb9105e474a4a29904722b1e33d0155 and project d3bd02ae79fd4edb9886b1b4ef3d761a. Resources: {'instances', 'ram', 'cores'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 12:23:11.714265 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-05a8e51d-d0b3-44ed-bb66-e8356768c7a1 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Going to run 1 instances... {{(pid=120462) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 12:23:11.717037 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-63a8c163-aae3-41b9-8ec5-c1cb3e8d8e14 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:11.717442 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-05a8e51d-d0b3-44ed-bb66-e8356768c7a1 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e3a8d95-6338-499c-af91-e3d1345af950',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 12:23:11.734146 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-63a8c163-aae3-41b9-8ec5-c1cb3e8d8e14 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 200 len: 1314 microversion: 2.1 time: 0.345630 Sep 21 12:23:11.740401 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 150/300] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:11 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:11.792478 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-05a8e51d-d0b3-44ed-bb66-e8356768c7a1 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.215094 Sep 21 12:23:11.793237 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 151/301] 10.222.0.71 () {60 vars in 1147 bytes} [Wed Sep 21 12:23:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 1217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 21 12:23:11.806446 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-115483be-621e-4599-962e-58501b3080c3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:11.807251 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-115483be-621e-4599-962e-58501b3080c3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:11.946526 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-115483be-621e-4599-962e-58501b3080c3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:11.960053 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-115483be-621e-4599-962e-58501b3080c3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1222 microversion: 2.1 time: 0.156413 Sep 21 12:23:11.962217 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 151/302] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:11 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1222 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:12.175108 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-6a2acaf8-386b-4495-b3d2-76d3cfe0af55 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1870471274", "imageRef": "1e3a8d95-6338-499c-af91-e3d1345af950", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:23:12.245017 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.network.neutron [None req-6a2acaf8-386b-4495-b3d2-76d3cfe0af55 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] validate_networks() for [('46771c4a-a4e0-44e3-b0ad-6700b1914d9d', None, None, None, None, None)] {{(pid=120462) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 12:23:12.761764 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-6bbfa609-c7e0-4879-a368-34d542e9de1f tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:12.763450 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-6bbfa609-c7e0-4879-a368-34d542e9de1f tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:12.783616 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6bbfa609-c7e0-4879-a368-34d542e9de1f tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:12.784374 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6bbfa609-c7e0-4879-a368-34d542e9de1f tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:12.787188 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6bbfa609-c7e0-4879-a368-34d542e9de1f tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:12.790739 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6bbfa609-c7e0-4879-a368-34d542e9de1f tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:12.792717 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6bbfa609-c7e0-4879-a368-34d542e9de1f tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:12.793182 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6bbfa609-c7e0-4879-a368-34d542e9de1f tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:12.921523 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-6a2acaf8-386b-4495-b3d2-76d3cfe0af55 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Flavor limits 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 12:23:12.921945 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-6a2acaf8-386b-4495-b3d2-76d3cfe0af55 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Image limits 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 12:23:12.922416 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-6a2acaf8-386b-4495-b3d2-76d3cfe0af55 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Flavor pref 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 12:23:12.922824 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-6a2acaf8-386b-4495-b3d2-76d3cfe0af55 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Image pref 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 12:23:12.923231 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-6a2acaf8-386b-4495-b3d2-76d3cfe0af55 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 12:23:12.941349 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6a2acaf8-386b-4495-b3d2-76d3cfe0af55 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:12.941846 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6a2acaf8-386b-4495-b3d2-76d3cfe0af55 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:12.942282 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6a2acaf8-386b-4495-b3d2-76d3cfe0af55 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:12.943018 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6a2acaf8-386b-4495-b3d2-76d3cfe0af55 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:12.943470 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6a2acaf8-386b-4495-b3d2-76d3cfe0af55 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:12.943929 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6a2acaf8-386b-4495-b3d2-76d3cfe0af55 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:12.996715 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-6a2acaf8-386b-4495-b3d2-76d3cfe0af55 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Getting quotas for project d3bd02ae79fd4edb9886b1b4ef3d761a. Resources: {'instances', 'ram', 'cores'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 12:23:13.006469 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-6a2acaf8-386b-4495-b3d2-76d3cfe0af55 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Getting quotas for user 0fb9105e474a4a29904722b1e33d0155 and project d3bd02ae79fd4edb9886b1b4ef3d761a. Resources: {'instances', 'ram', 'cores'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 12:23:13.089171 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-6a2acaf8-386b-4495-b3d2-76d3cfe0af55 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Going to run 1 instances... {{(pid=120462) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 12:23:13.093657 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-6a2acaf8-386b-4495-b3d2-76d3cfe0af55 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e3a8d95-6338-499c-af91-e3d1345af950',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 12:23:13.146992 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-6bbfa609-c7e0-4879-a368-34d542e9de1f tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:13.178640 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-6bbfa609-c7e0-4879-a368-34d542e9de1f tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 200 len: 1314 microversion: 2.1 time: 0.421546 Sep 21 12:23:13.207128 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 152/303] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:12 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:13.283695 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-6a2acaf8-386b-4495-b3d2-76d3cfe0af55 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.114162 Sep 21 12:23:13.297436 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 152/304] 10.222.0.71 () {60 vars in 1147 bytes} [Wed Sep 21 12:23:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 1128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 21 12:23:13.311341 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-7f848438-41e4-42d4-a0f7-0a1449a43d47 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:13.312118 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-7f848438-41e4-42d4-a0f7-0a1449a43d47 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:13.452060 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-7f848438-41e4-42d4-a0f7-0a1449a43d47 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:13.467585 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-7f848438-41e4-42d4-a0f7-0a1449a43d47 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1222 microversion: 2.1 time: 0.162688 Sep 21 12:23:13.485613 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 153/305] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:13 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1222 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:14.234832 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-37639336-e500-4d67-95b7-f39c498cbb92 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:14.235627 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-37639336-e500-4d67-95b7-f39c498cbb92 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:14.246018 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-37639336-e500-4d67-95b7-f39c498cbb92 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:14.252255 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-37639336-e500-4d67-95b7-f39c498cbb92 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:14.253246 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-37639336-e500-4d67-95b7-f39c498cbb92 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:14.254832 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-37639336-e500-4d67-95b7-f39c498cbb92 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:14.256730 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-37639336-e500-4d67-95b7-f39c498cbb92 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:14.257269 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-37639336-e500-4d67-95b7-f39c498cbb92 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:14.501910 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-c4d1bbfb-f708-4aad-b9f9-f9e18950bbe4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:14.503780 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-c4d1bbfb-f708-4aad-b9f9-f9e18950bbe4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:14.516205 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c4d1bbfb-f708-4aad-b9f9-f9e18950bbe4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:14.516964 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c4d1bbfb-f708-4aad-b9f9-f9e18950bbe4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:14.517581 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c4d1bbfb-f708-4aad-b9f9-f9e18950bbe4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:14.518331 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c4d1bbfb-f708-4aad-b9f9-f9e18950bbe4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:14.518946 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c4d1bbfb-f708-4aad-b9f9-f9e18950bbe4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:14.519524 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c4d1bbfb-f708-4aad-b9f9-f9e18950bbe4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:14.566881 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-37639336-e500-4d67-95b7-f39c498cbb92 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:14.582649 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-37639336-e500-4d67-95b7-f39c498cbb92 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 200 len: 1314 microversion: 2.1 time: 0.352383 Sep 21 12:23:14.584931 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 153/306] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:14 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:14.624511 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-c4d1bbfb-f708-4aad-b9f9-f9e18950bbe4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:14.646000 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-c4d1bbfb-f708-4aad-b9f9-f9e18950bbe4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1274 microversion: 2.1 time: 0.151099 Sep 21 12:23:14.652003 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 154/307] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:14 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1274 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:23:15.614438 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-3420f952-2eaf-4816-b0ea-93fe22c57580 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:15.615940 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-3420f952-2eaf-4816-b0ea-93fe22c57580 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:15.635479 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3420f952-2eaf-4816-b0ea-93fe22c57580 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:15.636434 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3420f952-2eaf-4816-b0ea-93fe22c57580 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:15.637655 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3420f952-2eaf-4816-b0ea-93fe22c57580 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:15.639142 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3420f952-2eaf-4816-b0ea-93fe22c57580 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:15.642427 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3420f952-2eaf-4816-b0ea-93fe22c57580 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:15.643335 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3420f952-2eaf-4816-b0ea-93fe22c57580 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:15.667604 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell0:SELECT=2 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:15.674584 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-19f15bca-8c1e-4937-ad92-66a26d3477a2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:15.675207 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-19f15bca-8c1e-4937-ad92-66a26d3477a2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:15.686761 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-19f15bca-8c1e-4937-ad92-66a26d3477a2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:15.687253 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-19f15bca-8c1e-4937-ad92-66a26d3477a2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:15.687691 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-19f15bca-8c1e-4937-ad92-66a26d3477a2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:15.688432 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-19f15bca-8c1e-4937-ad92-66a26d3477a2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:15.688886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-19f15bca-8c1e-4937-ad92-66a26d3477a2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:15.696019 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-19f15bca-8c1e-4937-ad92-66a26d3477a2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:15.845333 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-19f15bca-8c1e-4937-ad92-66a26d3477a2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:15.899500 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-19f15bca-8c1e-4937-ad92-66a26d3477a2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1292 microversion: 2.1 time: 0.232868 Sep 21 12:23:15.905087 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 155/308] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:15 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1292 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:16.185676 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-7138f403-6fbf-477b-bc4a-5299154d88c3 req-2b922b96-cfe3-4a13-942a-548c4b04af37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "309d01e5-d152-40c7-bbe0-db2292d5f103", "name": "network-vif-plugged", "status": "completed", "tag": "31c51ceb-171d-4706-b582-46630abdaa5b"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:23:16.204863 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-7138f403-6fbf-477b-bc4a-5299154d88c3 req-2b922b96-cfe3-4a13-942a-548c4b04af37 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:16.206460 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-7138f403-6fbf-477b-bc4a-5299154d88c3 req-2b922b96-cfe3-4a13-942a-548c4b04af37 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:16.207183 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-7138f403-6fbf-477b-bc4a-5299154d88c3 req-2b922b96-cfe3-4a13-942a-548c4b04af37 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:16.207973 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-3420f952-2eaf-4816-b0ea-93fe22c57580 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:16.225189 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-7138f403-6fbf-477b-bc4a-5299154d88c3 req-2b922b96-cfe3-4a13-942a-548c4b04af37 service nova] Creating event network-vif-plugged:31c51ceb-171d-4706-b582-46630abdaa5b for instance 309d01e5-d152-40c7-bbe0-db2292d5f103 on hv-cinder-85867 Sep 21 12:23:16.225391 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-3420f952-2eaf-4816-b0ea-93fe22c57580 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 200 len: 1314 microversion: 2.1 time: 0.616978 Sep 21 12:23:16.226011 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 154/309] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:15 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 1314 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:16.243566 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-7138f403-6fbf-477b-bc4a-5299154d88c3 req-2b922b96-cfe3-4a13-942a-548c4b04af37 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062622 Sep 21 12:23:16.244791 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 156/310] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 12:23:16.929688 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-250e4205-4f96-4449-aba9-077b41f8380f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:16.931084 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-250e4205-4f96-4449-aba9-077b41f8380f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:16.937422 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-250e4205-4f96-4449-aba9-077b41f8380f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:16.938287 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-250e4205-4f96-4449-aba9-077b41f8380f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:16.938789 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-250e4205-4f96-4449-aba9-077b41f8380f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:16.939859 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-250e4205-4f96-4449-aba9-077b41f8380f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:16.940665 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-250e4205-4f96-4449-aba9-077b41f8380f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:16.941197 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-250e4205-4f96-4449-aba9-077b41f8380f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:17.117304 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-250e4205-4f96-4449-aba9-077b41f8380f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:17.130618 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-250e4205-4f96-4449-aba9-077b41f8380f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1280 microversion: 2.1 time: 0.204495 Sep 21 12:23:17.131455 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 155/311] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:16 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1280 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:17.250414 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-72887a25-f37e-4489-97ac-01109eb9e19c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:17.251499 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-72887a25-f37e-4489-97ac-01109eb9e19c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:17.262035 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-72887a25-f37e-4489-97ac-01109eb9e19c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:17.264083 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-72887a25-f37e-4489-97ac-01109eb9e19c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:17.264853 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-72887a25-f37e-4489-97ac-01109eb9e19c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:17.266199 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-72887a25-f37e-4489-97ac-01109eb9e19c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:17.266684 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-72887a25-f37e-4489-97ac-01109eb9e19c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:17.267237 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-72887a25-f37e-4489-97ac-01109eb9e19c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:17.297624 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:17.475873 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-72887a25-f37e-4489-97ac-01109eb9e19c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:17.490917 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-72887a25-f37e-4489-97ac-01109eb9e19c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 200 len: 1314 microversion: 2.1 time: 0.245055 Sep 21 12:23:17.492180 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 157/312] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:17 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:17.722804 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-e4ee3d72-c887-41bd-aa1a-266f02868c8f req-48aabeb2-0af6-46b5-9a18-1e4cbaa0dc04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5560ddde-2668-4e31-bbbf-b94d7485df5a", "tag": "3fb9b2d0-df9a-421a-b7da-b2bbf6f67639"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:23:17.738521 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-e4ee3d72-c887-41bd-aa1a-266f02868c8f req-48aabeb2-0af6-46b5-9a18-1e4cbaa0dc04 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:17.739525 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-e4ee3d72-c887-41bd-aa1a-266f02868c8f req-48aabeb2-0af6-46b5-9a18-1e4cbaa0dc04 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:17.740172 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-e4ee3d72-c887-41bd-aa1a-266f02868c8f req-48aabeb2-0af6-46b5-9a18-1e4cbaa0dc04 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:17.759780 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-e4ee3d72-c887-41bd-aa1a-266f02868c8f req-48aabeb2-0af6-46b5-9a18-1e4cbaa0dc04 service nova] Creating event network-changed:3fb9b2d0-df9a-421a-b7da-b2bbf6f67639 for instance 5560ddde-2668-4e31-bbbf-b94d7485df5a on hv-cinder-85867 Sep 21 12:23:17.768707 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-e4ee3d72-c887-41bd-aa1a-266f02868c8f req-48aabeb2-0af6-46b5-9a18-1e4cbaa0dc04 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050488 Sep 21 12:23:17.769761 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 156/313] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:23:18.158100 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-c104f988-2c48-47f6-ae4a-d609a3c7673f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:18.158758 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-c104f988-2c48-47f6-ae4a-d609a3c7673f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:18.166925 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c104f988-2c48-47f6-ae4a-d609a3c7673f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:18.167496 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c104f988-2c48-47f6-ae4a-d609a3c7673f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:18.168606 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c104f988-2c48-47f6-ae4a-d609a3c7673f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:18.170166 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c104f988-2c48-47f6-ae4a-d609a3c7673f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:18.170843 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c104f988-2c48-47f6-ae4a-d609a3c7673f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:18.171347 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c104f988-2c48-47f6-ae4a-d609a3c7673f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:18.316111 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-c104f988-2c48-47f6-ae4a-d609a3c7673f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:18.324086 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-c104f988-2c48-47f6-ae4a-d609a3c7673f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1322 microversion: 2.1 time: 0.170951 Sep 21 12:23:18.324852 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 158/314] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:18 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:18.523331 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-83253317-a2b2-4fc3-991f-ea2985cb321d tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:18.525277 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-83253317-a2b2-4fc3-991f-ea2985cb321d tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:18.539605 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-83253317-a2b2-4fc3-991f-ea2985cb321d tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:18.540140 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-83253317-a2b2-4fc3-991f-ea2985cb321d tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:18.540579 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-83253317-a2b2-4fc3-991f-ea2985cb321d tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:18.544259 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-83253317-a2b2-4fc3-991f-ea2985cb321d tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:18.548385 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-83253317-a2b2-4fc3-991f-ea2985cb321d tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:18.549042 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-83253317-a2b2-4fc3-991f-ea2985cb321d tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:18.848271 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-83253317-a2b2-4fc3-991f-ea2985cb321d tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:18.857921 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-83253317-a2b2-4fc3-991f-ea2985cb321d tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 200 len: 1314 microversion: 2.1 time: 0.339311 Sep 21 12:23:18.859315 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 157/315] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:18 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:19.346724 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-e08fea2b-b6ef-4ee7-b7f3-96e0fe645c58 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:19.347339 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-e08fea2b-b6ef-4ee7-b7f3-96e0fe645c58 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:19.354228 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e08fea2b-b6ef-4ee7-b7f3-96e0fe645c58 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:19.354720 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e08fea2b-b6ef-4ee7-b7f3-96e0fe645c58 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:19.355161 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e08fea2b-b6ef-4ee7-b7f3-96e0fe645c58 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:19.355895 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e08fea2b-b6ef-4ee7-b7f3-96e0fe645c58 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:19.356358 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e08fea2b-b6ef-4ee7-b7f3-96e0fe645c58 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:19.357323 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e08fea2b-b6ef-4ee7-b7f3-96e0fe645c58 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:19.489713 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-e08fea2b-b6ef-4ee7-b7f3-96e0fe645c58 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:19.498405 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-e08fea2b-b6ef-4ee7-b7f3-96e0fe645c58 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1322 microversion: 2.1 time: 0.154844 Sep 21 12:23:19.498984 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 159/316] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:19 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:19.801122 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-b69c8950-fa0c-469a-8708-968e6e3186f2 req-1902f9e4-85b0-4c56-a1f0-063458533b5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de0f1a98-9419-4e35-b8e0-520c7fc482fb", "tag": "16f7d649-433e-42b0-aede-b34b15fd092f"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:23:19.810618 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-b69c8950-fa0c-469a-8708-968e6e3186f2 req-1902f9e4-85b0-4c56-a1f0-063458533b5d service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:19.811171 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-b69c8950-fa0c-469a-8708-968e6e3186f2 req-1902f9e4-85b0-4c56-a1f0-063458533b5d service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:19.811630 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-b69c8950-fa0c-469a-8708-968e6e3186f2 req-1902f9e4-85b0-4c56-a1f0-063458533b5d service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:19.822313 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-b69c8950-fa0c-469a-8708-968e6e3186f2 req-1902f9e4-85b0-4c56-a1f0-063458533b5d service nova] Creating event network-changed:16f7d649-433e-42b0-aede-b34b15fd092f for instance de0f1a98-9419-4e35-b8e0-520c7fc482fb on hv-cinder-85867 Sep 21 12:23:19.827052 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-b69c8950-fa0c-469a-8708-968e6e3186f2 req-1902f9e4-85b0-4c56-a1f0-063458533b5d service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029630 Sep 21 12:23:19.827636 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 158/317] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:23:19.882626 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-5bbf5130-6faa-4364-800c-70b79091296e tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:19.883546 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-5bbf5130-6faa-4364-800c-70b79091296e tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:19.890364 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5bbf5130-6faa-4364-800c-70b79091296e tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:19.891097 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5bbf5130-6faa-4364-800c-70b79091296e tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:19.891548 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5bbf5130-6faa-4364-800c-70b79091296e tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:19.892281 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5bbf5130-6faa-4364-800c-70b79091296e tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:19.892752 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5bbf5130-6faa-4364-800c-70b79091296e tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:19.893185 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5bbf5130-6faa-4364-800c-70b79091296e tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:20.033497 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-5bbf5130-6faa-4364-800c-70b79091296e tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:20.041229 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-5bbf5130-6faa-4364-800c-70b79091296e tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 200 len: 1498 microversion: 2.1 time: 0.162620 Sep 21 12:23:20.041785 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 160/318] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:19 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 1498 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:20.145375 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-afeec9b6-8ace-466d-843e-b53f557878e0 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-360388960", "imageRef": "1e3a8d95-6338-499c-af91-e3d1345af950", "flavorRef": "452"}} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:23:20.209044 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.network.neutron [None req-afeec9b6-8ace-466d-843e-b53f557878e0 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] validate_networks() for None {{(pid=120462) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 12:23:20.520766 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-711089a5-45ba-4a7d-b7a3-ce9880571a9e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:20.521497 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-711089a5-45ba-4a7d-b7a3-ce9880571a9e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:20.528226 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-711089a5-45ba-4a7d-b7a3-ce9880571a9e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:20.528722 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-711089a5-45ba-4a7d-b7a3-ce9880571a9e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:20.529164 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-711089a5-45ba-4a7d-b7a3-ce9880571a9e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:20.529877 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-711089a5-45ba-4a7d-b7a3-ce9880571a9e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:20.530336 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-711089a5-45ba-4a7d-b7a3-ce9880571a9e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:20.530766 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-711089a5-45ba-4a7d-b7a3-ce9880571a9e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:20.675021 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-711089a5-45ba-4a7d-b7a3-ce9880571a9e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:20.683013 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-711089a5-45ba-4a7d-b7a3-ce9880571a9e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1322 microversion: 2.1 time: 0.166215 Sep 21 12:23:20.683601 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 161/319] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:20 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:23:20.694111 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-2e3c5d19-328f-4ec8-aabe-3cead26f18bf tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:20.694612 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-2e3c5d19-328f-4ec8-aabe-3cead26f18bf tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:20.700603 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2e3c5d19-328f-4ec8-aabe-3cead26f18bf tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:20.701095 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2e3c5d19-328f-4ec8-aabe-3cead26f18bf tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:20.701531 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2e3c5d19-328f-4ec8-aabe-3cead26f18bf tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:20.702237 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2e3c5d19-328f-4ec8-aabe-3cead26f18bf tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:20.702690 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2e3c5d19-328f-4ec8-aabe-3cead26f18bf tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:20.703120 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2e3c5d19-328f-4ec8-aabe-3cead26f18bf tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:20.711435 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-afeec9b6-8ace-466d-843e-b53f557878e0 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Flavor limits 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 12:23:20.711978 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-afeec9b6-8ace-466d-843e-b53f557878e0 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Image limits 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 12:23:20.712548 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-afeec9b6-8ace-466d-843e-b53f557878e0 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Flavor pref 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 12:23:20.713128 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-afeec9b6-8ace-466d-843e-b53f557878e0 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Image pref 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 12:23:20.713541 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-afeec9b6-8ace-466d-843e-b53f557878e0 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 12:23:20.722788 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-afeec9b6-8ace-466d-843e-b53f557878e0 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:20.723282 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-afeec9b6-8ace-466d-843e-b53f557878e0 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:20.723745 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-afeec9b6-8ace-466d-843e-b53f557878e0 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:20.724535 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-afeec9b6-8ace-466d-843e-b53f557878e0 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:20.725212 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-afeec9b6-8ace-466d-843e-b53f557878e0 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:20.725773 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-afeec9b6-8ace-466d-843e-b53f557878e0 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:20.728323 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-2e3c5d19-328f-4ec8-aabe-3cead26f18bf tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Going to try to terminate instance {{(pid=120463) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 12:23:20.744532 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-afeec9b6-8ace-466d-843e-b53f557878e0 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Getting quotas for project 1a86f263882a44f385804b84f83d735c. Resources: {'instances', 'ram', 'cores'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 12:23:20.749218 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-afeec9b6-8ace-466d-843e-b53f557878e0 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Getting quotas for user 0c80648c3936461295821ce1431a4164 and project 1a86f263882a44f385804b84f83d735c. Resources: {'instances', 'ram', 'cores'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 12:23:20.760420 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-afeec9b6-8ace-466d-843e-b53f557878e0 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Going to run 1 instances... {{(pid=120462) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 12:23:20.762835 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-afeec9b6-8ace-466d-843e-b53f557878e0 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e3a8d95-6338-499c-af91-e3d1345af950',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 12:23:20.809362 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-afeec9b6-8ace-466d-843e-b53f557878e0 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.668713 Sep 21 12:23:20.810610 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 159/320] 10.222.0.71 () {60 vars in 1147 bytes} [Wed Sep 21 12:23:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 21 12:23:20.813361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-2e3c5d19-328f-4ec8-aabe-3cead26f18bf tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "DELETE /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 204 len: 0 microversion: 2.1 time: 0.122842 Sep 21 12:23:20.813973 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 162/321] 10.222.0.71 () {58 vars in 1239 bytes} [Wed Sep 21 12:23:20 2022] DELETE /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 21 12:23:20.825286 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-4da3d790-7634-4764-80b7-bef5415fcf97 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:20.826154 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-4da3d790-7634-4764-80b7-bef5415fcf97 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:20.826820 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-a203e8ff-2991-4193-b1db-ab7ac93b0d71 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:20.827536 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-a203e8ff-2991-4193-b1db-ab7ac93b0d71 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:20.833944 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a203e8ff-2991-4193-b1db-ab7ac93b0d71 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:20.834614 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a203e8ff-2991-4193-b1db-ab7ac93b0d71 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:20.835241 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a203e8ff-2991-4193-b1db-ab7ac93b0d71 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:20.835787 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a203e8ff-2991-4193-b1db-ab7ac93b0d71 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:20.836471 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a203e8ff-2991-4193-b1db-ab7ac93b0d71 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:20.837053 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a203e8ff-2991-4193-b1db-ab7ac93b0d71 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:20.892739 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-4da3d790-7634-4764-80b7-bef5415fcf97 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:20.899866 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-4da3d790-7634-4764-80b7-bef5415fcf97 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1214 microversion: 2.1 time: 0.078861 Sep 21 12:23:20.900642 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 160/322] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:20 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:20.981562 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a203e8ff-2991-4193-b1db-ab7ac93b0d71 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:20.990513 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-a203e8ff-2991-4193-b1db-ab7ac93b0d71 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 200 len: 1504 microversion: 2.1 time: 0.169246 Sep 21 12:23:20.991289 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 163/323] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:20 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:23:21.707011 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-3b44971c-2bc7-4be9-a495-fcdc72202707 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:21.707638 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-3b44971c-2bc7-4be9-a495-fcdc72202707 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:21.713796 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3b44971c-2bc7-4be9-a495-fcdc72202707 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:21.714276 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3b44971c-2bc7-4be9-a495-fcdc72202707 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:21.714706 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3b44971c-2bc7-4be9-a495-fcdc72202707 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:21.715391 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3b44971c-2bc7-4be9-a495-fcdc72202707 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:21.715864 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3b44971c-2bc7-4be9-a495-fcdc72202707 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:21.716898 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3b44971c-2bc7-4be9-a495-fcdc72202707 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:21.847049 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-3b44971c-2bc7-4be9-a495-fcdc72202707 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:21.854712 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-3b44971c-2bc7-4be9-a495-fcdc72202707 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1322 microversion: 2.1 time: 0.151813 Sep 21 12:23:21.855288 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 161/324] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:21 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:21.922374 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-6bb52854-6899-4183-86f0-c5a2d66840f1 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:21.922983 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-6bb52854-6899-4183-86f0-c5a2d66840f1 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:21.925437 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:21.930614 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6bb52854-6899-4183-86f0-c5a2d66840f1 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:21.931092 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6bb52854-6899-4183-86f0-c5a2d66840f1 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:21.931528 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6bb52854-6899-4183-86f0-c5a2d66840f1 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:21.932237 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6bb52854-6899-4183-86f0-c5a2d66840f1 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:21.932703 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6bb52854-6899-4183-86f0-c5a2d66840f1 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:21.933126 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6bb52854-6899-4183-86f0-c5a2d66840f1 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:21.994543 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-6bb52854-6899-4183-86f0-c5a2d66840f1 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:22.002901 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-6bb52854-6899-4183-86f0-c5a2d66840f1 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1218 microversion: 2.1 time: 0.084362 Sep 21 12:23:22.003464 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 164/325] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:21 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:22.014952 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-b56aab81-22ca-410a-a915-15180d73fa3a tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:22.015471 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-b56aab81-22ca-410a-a915-15180d73fa3a tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:22.021428 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b56aab81-22ca-410a-a915-15180d73fa3a tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:22.021899 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b56aab81-22ca-410a-a915-15180d73fa3a tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:22.022329 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b56aab81-22ca-410a-a915-15180d73fa3a tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:22.023004 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b56aab81-22ca-410a-a915-15180d73fa3a tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:22.023457 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b56aab81-22ca-410a-a915-15180d73fa3a tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:22.023899 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b56aab81-22ca-410a-a915-15180d73fa3a tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:22.150656 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-b56aab81-22ca-410a-a915-15180d73fa3a tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:22.158319 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-b56aab81-22ca-410a-a915-15180d73fa3a tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 200 len: 1504 microversion: 2.1 time: 0.148019 Sep 21 12:23:22.158877 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 162/326] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:22 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:22.878119 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-c1f68fe7-bd6a-4a0a-b7ab-dd88aa332059 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:22.878723 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-c1f68fe7-bd6a-4a0a-b7ab-dd88aa332059 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:22.884886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c1f68fe7-bd6a-4a0a-b7ab-dd88aa332059 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:22.885378 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c1f68fe7-bd6a-4a0a-b7ab-dd88aa332059 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:22.885811 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c1f68fe7-bd6a-4a0a-b7ab-dd88aa332059 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:22.886508 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c1f68fe7-bd6a-4a0a-b7ab-dd88aa332059 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:22.886955 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c1f68fe7-bd6a-4a0a-b7ab-dd88aa332059 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:22.887377 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c1f68fe7-bd6a-4a0a-b7ab-dd88aa332059 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:23.014156 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-c1f68fe7-bd6a-4a0a-b7ab-dd88aa332059 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:23.022156 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-c1f68fe7-bd6a-4a0a-b7ab-dd88aa332059 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1322 microversion: 2.1 time: 0.147974 Sep 21 12:23:23.022673 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 165/327] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:22 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:23.026191 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-7fdecf4e-bd65-45ac-910d-18dd733806b0 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:23.026807 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-7fdecf4e-bd65-45ac-910d-18dd733806b0 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:23.033339 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7fdecf4e-bd65-45ac-910d-18dd733806b0 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:23.033827 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7fdecf4e-bd65-45ac-910d-18dd733806b0 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:23.034274 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7fdecf4e-bd65-45ac-910d-18dd733806b0 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:23.034958 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7fdecf4e-bd65-45ac-910d-18dd733806b0 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:23.035413 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7fdecf4e-bd65-45ac-910d-18dd733806b0 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:23.036042 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7fdecf4e-bd65-45ac-910d-18dd733806b0 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:23.038671 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=93 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:23.096646 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-7fdecf4e-bd65-45ac-910d-18dd733806b0 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:23.104255 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-7fdecf4e-bd65-45ac-910d-18dd733806b0 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1218 microversion: 2.1 time: 0.082017 Sep 21 12:23:23.104826 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 163/328] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:23 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:23:23.183540 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-9852b289-979b-46fc-a1be-99d8334136af tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:23.183540 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-9852b289-979b-46fc-a1be-99d8334136af tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:23.188506 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9852b289-979b-46fc-a1be-99d8334136af tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:23.189008 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9852b289-979b-46fc-a1be-99d8334136af tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:23.189452 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9852b289-979b-46fc-a1be-99d8334136af tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:23.190153 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9852b289-979b-46fc-a1be-99d8334136af tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:23.190617 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9852b289-979b-46fc-a1be-99d8334136af tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:23.191050 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9852b289-979b-46fc-a1be-99d8334136af tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:23.322476 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-9852b289-979b-46fc-a1be-99d8334136af tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:23.331213 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-9852b289-979b-46fc-a1be-99d8334136af tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 200 len: 1504 microversion: 2.1 time: 0.153370 Sep 21 12:23:23.331803 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 166/329] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:23 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:24.045612 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-82a11b51-475b-42a6-a1aa-e65473db888d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:24.046261 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-82a11b51-475b-42a6-a1aa-e65473db888d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:24.052799 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-82a11b51-475b-42a6-a1aa-e65473db888d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:24.053326 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-82a11b51-475b-42a6-a1aa-e65473db888d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:24.053811 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-82a11b51-475b-42a6-a1aa-e65473db888d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:24.054577 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-82a11b51-475b-42a6-a1aa-e65473db888d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:24.055036 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-82a11b51-475b-42a6-a1aa-e65473db888d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:24.055469 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-82a11b51-475b-42a6-a1aa-e65473db888d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:24.127060 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-c336aa10-1a13-4d1b-a4d6-852b7e64fb2b tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:24.127684 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-c336aa10-1a13-4d1b-a4d6-852b7e64fb2b tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:24.129562 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell0:SELECT=10 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:24.135590 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c336aa10-1a13-4d1b-a4d6-852b7e64fb2b tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:24.136187 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c336aa10-1a13-4d1b-a4d6-852b7e64fb2b tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:24.136636 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c336aa10-1a13-4d1b-a4d6-852b7e64fb2b tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:24.137344 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c336aa10-1a13-4d1b-a4d6-852b7e64fb2b tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:24.137813 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c336aa10-1a13-4d1b-a4d6-852b7e64fb2b tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:24.138247 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c336aa10-1a13-4d1b-a4d6-852b7e64fb2b tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:24.186423 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-82a11b51-475b-42a6-a1aa-e65473db888d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:24.194135 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-82a11b51-475b-42a6-a1aa-e65473db888d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1322 microversion: 2.1 time: 0.153139 Sep 21 12:23:24.194690 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 164/330] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:24 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:24.200843 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-c336aa10-1a13-4d1b-a4d6-852b7e64fb2b tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:24.209027 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-c336aa10-1a13-4d1b-a4d6-852b7e64fb2b tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1218 microversion: 2.1 time: 0.085791 Sep 21 12:23:24.209642 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 167/331] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:24 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:23:24.353821 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-a2ad9b8a-2cee-4d70-b9a9-59cf0c5f4e77 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:24.354439 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-a2ad9b8a-2cee-4d70-b9a9-59cf0c5f4e77 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:24.360314 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a2ad9b8a-2cee-4d70-b9a9-59cf0c5f4e77 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:24.360793 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a2ad9b8a-2cee-4d70-b9a9-59cf0c5f4e77 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:24.361228 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a2ad9b8a-2cee-4d70-b9a9-59cf0c5f4e77 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:24.361949 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a2ad9b8a-2cee-4d70-b9a9-59cf0c5f4e77 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:24.362407 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a2ad9b8a-2cee-4d70-b9a9-59cf0c5f4e77 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:24.362836 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a2ad9b8a-2cee-4d70-b9a9-59cf0c5f4e77 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:24.492117 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-a2ad9b8a-2cee-4d70-b9a9-59cf0c5f4e77 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:24.499786 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-a2ad9b8a-2cee-4d70-b9a9-59cf0c5f4e77 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 200 len: 1504 microversion: 2.1 time: 0.149861 Sep 21 12:23:24.500380 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 165/332] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:24 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:25.217222 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-d70c637b-d591-4eff-bf14-c5dedf9e8e60 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:25.217831 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-d70c637b-d591-4eff-bf14-c5dedf9e8e60 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:25.224364 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d70c637b-d591-4eff-bf14-c5dedf9e8e60 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:25.224843 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d70c637b-d591-4eff-bf14-c5dedf9e8e60 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:25.225278 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d70c637b-d591-4eff-bf14-c5dedf9e8e60 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:25.225992 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d70c637b-d591-4eff-bf14-c5dedf9e8e60 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:25.226455 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d70c637b-d591-4eff-bf14-c5dedf9e8e60 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:25.226926 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d70c637b-d591-4eff-bf14-c5dedf9e8e60 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:25.232209 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-0768103b-fe12-49a2-a8ab-1b6adc2529fb tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:25.232852 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-0768103b-fe12-49a2-a8ab-1b6adc2529fb tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:25.235189 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:25.240537 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0768103b-fe12-49a2-a8ab-1b6adc2529fb tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:25.241029 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0768103b-fe12-49a2-a8ab-1b6adc2529fb tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:25.241471 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0768103b-fe12-49a2-a8ab-1b6adc2529fb tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:25.242165 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0768103b-fe12-49a2-a8ab-1b6adc2529fb tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:25.242661 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0768103b-fe12-49a2-a8ab-1b6adc2529fb tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:25.243057 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0768103b-fe12-49a2-a8ab-1b6adc2529fb tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:25.305317 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-0768103b-fe12-49a2-a8ab-1b6adc2529fb tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:25.314203 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-0768103b-fe12-49a2-a8ab-1b6adc2529fb tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1218 microversion: 2.1 time: 0.085716 Sep 21 12:23:25.323640 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 166/333] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:25 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:23:25.359870 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-d70c637b-d591-4eff-bf14-c5dedf9e8e60 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:25.367588 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-d70c637b-d591-4eff-bf14-c5dedf9e8e60 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1322 microversion: 2.1 time: 0.154236 Sep 21 12:23:25.368177 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 168/334] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:25 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:25.522444 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-e0deed3a-1d01-4e0a-987f-1b7bc513aeed tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:25.523054 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-e0deed3a-1d01-4e0a-987f-1b7bc513aeed tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:25.528928 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e0deed3a-1d01-4e0a-987f-1b7bc513aeed tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:25.529395 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e0deed3a-1d01-4e0a-987f-1b7bc513aeed tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:25.529827 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e0deed3a-1d01-4e0a-987f-1b7bc513aeed tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:25.530511 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e0deed3a-1d01-4e0a-987f-1b7bc513aeed tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:25.531467 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e0deed3a-1d01-4e0a-987f-1b7bc513aeed tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:25.531964 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e0deed3a-1d01-4e0a-987f-1b7bc513aeed tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:25.663734 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-e0deed3a-1d01-4e0a-987f-1b7bc513aeed tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:25.672055 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-e0deed3a-1d01-4e0a-987f-1b7bc513aeed tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 200 len: 1504 microversion: 2.1 time: 0.152717 Sep 21 12:23:25.672626 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 167/335] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:25 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:26.337823 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-7379e760-f932-465b-88dc-6bb239caae77 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:26.338823 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-7379e760-f932-465b-88dc-6bb239caae77 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:26.345392 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7379e760-f932-465b-88dc-6bb239caae77 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:26.345882 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7379e760-f932-465b-88dc-6bb239caae77 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:26.346326 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7379e760-f932-465b-88dc-6bb239caae77 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:26.347141 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7379e760-f932-465b-88dc-6bb239caae77 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:26.347673 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7379e760-f932-465b-88dc-6bb239caae77 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:26.348128 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7379e760-f932-465b-88dc-6bb239caae77 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:26.391134 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-d5368189-eee2-4e5a-8fb3-e94daaac81e1 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:26.391745 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-d5368189-eee2-4e5a-8fb3-e94daaac81e1 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:26.399073 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d5368189-eee2-4e5a-8fb3-e94daaac81e1 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:26.399747 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d5368189-eee2-4e5a-8fb3-e94daaac81e1 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:26.400232 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d5368189-eee2-4e5a-8fb3-e94daaac81e1 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:26.400937 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d5368189-eee2-4e5a-8fb3-e94daaac81e1 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:26.401442 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d5368189-eee2-4e5a-8fb3-e94daaac81e1 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:26.401825 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d5368189-eee2-4e5a-8fb3-e94daaac81e1 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:26.414914 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-7379e760-f932-465b-88dc-6bb239caae77 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:26.424027 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-7379e760-f932-465b-88dc-6bb239caae77 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1218 microversion: 2.1 time: 0.090700 Sep 21 12:23:26.432201 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 169/336] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:26 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:26.539046 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-d5368189-eee2-4e5a-8fb3-e94daaac81e1 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:26.547557 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-d5368189-eee2-4e5a-8fb3-e94daaac81e1 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1322 microversion: 2.1 time: 0.160731 Sep 21 12:23:26.548172 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 168/337] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:26 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:26.694797 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-2b2862fe-1e55-4332-adbd-f84a27421cd8 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:26.695344 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-2b2862fe-1e55-4332-adbd-f84a27421cd8 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:26.701179 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2b2862fe-1e55-4332-adbd-f84a27421cd8 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:26.701661 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2b2862fe-1e55-4332-adbd-f84a27421cd8 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:26.702118 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2b2862fe-1e55-4332-adbd-f84a27421cd8 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:26.702851 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2b2862fe-1e55-4332-adbd-f84a27421cd8 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:26.703301 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2b2862fe-1e55-4332-adbd-f84a27421cd8 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:26.703722 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2b2862fe-1e55-4332-adbd-f84a27421cd8 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:26.832437 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-2b2862fe-1e55-4332-adbd-f84a27421cd8 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:26.840036 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-2b2862fe-1e55-4332-adbd-f84a27421cd8 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 200 len: 1504 microversion: 2.1 time: 0.149255 Sep 21 12:23:26.840614 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 170/338] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:26 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:27.446490 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-65d92ba5-2a5c-4f34-9d19-cafe24acec91 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:27.447107 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-65d92ba5-2a5c-4f34-9d19-cafe24acec91 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:27.453526 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-65d92ba5-2a5c-4f34-9d19-cafe24acec91 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:27.454012 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-65d92ba5-2a5c-4f34-9d19-cafe24acec91 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:27.454453 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-65d92ba5-2a5c-4f34-9d19-cafe24acec91 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:27.455149 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-65d92ba5-2a5c-4f34-9d19-cafe24acec91 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:27.455890 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-65d92ba5-2a5c-4f34-9d19-cafe24acec91 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:27.456320 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-65d92ba5-2a5c-4f34-9d19-cafe24acec91 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:27.519322 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-65d92ba5-2a5c-4f34-9d19-cafe24acec91 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:27.527162 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-65d92ba5-2a5c-4f34-9d19-cafe24acec91 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1218 microversion: 2.1 time: 0.084556 Sep 21 12:23:27.527739 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 169/339] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:27 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:27.574467 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-73201796-05cd-4fda-9ef6-3f121b5f7819 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:27.575196 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-73201796-05cd-4fda-9ef6-3f121b5f7819 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:27.586060 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-73201796-05cd-4fda-9ef6-3f121b5f7819 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:27.587045 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-73201796-05cd-4fda-9ef6-3f121b5f7819 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:27.587743 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-73201796-05cd-4fda-9ef6-3f121b5f7819 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:27.588778 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-73201796-05cd-4fda-9ef6-3f121b5f7819 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:27.589544 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-73201796-05cd-4fda-9ef6-3f121b5f7819 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:27.589880 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-73201796-05cd-4fda-9ef6-3f121b5f7819 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:27.725747 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-73201796-05cd-4fda-9ef6-3f121b5f7819 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:27.733587 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-73201796-05cd-4fda-9ef6-3f121b5f7819 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1322 microversion: 2.1 time: 0.166685 Sep 21 12:23:27.734211 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 171/340] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:27 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:27.862917 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-fa4f21a9-c4b1-465f-807c-fec0878b9074 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:27.863864 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-fa4f21a9-c4b1-465f-807c-fec0878b9074 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:27.870243 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fa4f21a9-c4b1-465f-807c-fec0878b9074 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:27.870927 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fa4f21a9-c4b1-465f-807c-fec0878b9074 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:27.871581 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fa4f21a9-c4b1-465f-807c-fec0878b9074 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:27.872319 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fa4f21a9-c4b1-465f-807c-fec0878b9074 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:27.872939 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fa4f21a9-c4b1-465f-807c-fec0878b9074 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:27.873373 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fa4f21a9-c4b1-465f-807c-fec0878b9074 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:28.033471 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-fa4f21a9-c4b1-465f-807c-fec0878b9074 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:28.041757 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-fa4f21a9-c4b1-465f-807c-fec0878b9074 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 200 len: 1504 microversion: 2.1 time: 0.182962 Sep 21 12:23:28.042329 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 170/341] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:27 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:28.551185 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-4bc956b7-6d8f-46af-8a45-6b3e7e42dc04 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:28.551821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-4bc956b7-6d8f-46af-8a45-6b3e7e42dc04 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:28.557799 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4bc956b7-6d8f-46af-8a45-6b3e7e42dc04 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:28.558282 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4bc956b7-6d8f-46af-8a45-6b3e7e42dc04 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:28.558719 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4bc956b7-6d8f-46af-8a45-6b3e7e42dc04 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:28.559406 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4bc956b7-6d8f-46af-8a45-6b3e7e42dc04 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:28.559894 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4bc956b7-6d8f-46af-8a45-6b3e7e42dc04 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:28.560321 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4bc956b7-6d8f-46af-8a45-6b3e7e42dc04 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:28.564255 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:28.625851 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-4bc956b7-6d8f-46af-8a45-6b3e7e42dc04 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:28.633417 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-4bc956b7-6d8f-46af-8a45-6b3e7e42dc04 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1218 microversion: 2.1 time: 0.086176 Sep 21 12:23:28.633983 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 172/342] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:28 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:28.755994 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-406bddb9-d40e-443b-9423-7a74344fcf88 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:28.756609 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-406bddb9-d40e-443b-9423-7a74344fcf88 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:28.762474 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-406bddb9-d40e-443b-9423-7a74344fcf88 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:28.762965 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-406bddb9-d40e-443b-9423-7a74344fcf88 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:28.763410 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-406bddb9-d40e-443b-9423-7a74344fcf88 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:28.764143 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-406bddb9-d40e-443b-9423-7a74344fcf88 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:28.764596 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-406bddb9-d40e-443b-9423-7a74344fcf88 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:28.765206 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-406bddb9-d40e-443b-9423-7a74344fcf88 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:28.902886 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-406bddb9-d40e-443b-9423-7a74344fcf88 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:28.911236 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-406bddb9-d40e-443b-9423-7a74344fcf88 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1322 microversion: 2.1 time: 0.158997 Sep 21 12:23:28.911842 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 171/343] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:28 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:29.064430 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-0a38f848-0b85-4342-9a9e-05b2ed53d783 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:29.065049 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-0a38f848-0b85-4342-9a9e-05b2ed53d783 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:29.071970 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0a38f848-0b85-4342-9a9e-05b2ed53d783 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:29.072863 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0a38f848-0b85-4342-9a9e-05b2ed53d783 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:29.073626 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0a38f848-0b85-4342-9a9e-05b2ed53d783 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:29.074917 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0a38f848-0b85-4342-9a9e-05b2ed53d783 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:29.075728 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0a38f848-0b85-4342-9a9e-05b2ed53d783 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:29.076510 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0a38f848-0b85-4342-9a9e-05b2ed53d783 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:29.255166 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-0a38f848-0b85-4342-9a9e-05b2ed53d783 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:29.263145 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-0a38f848-0b85-4342-9a9e-05b2ed53d783 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 200 len: 1504 microversion: 2.1 time: 0.202604 Sep 21 12:23:29.263835 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 173/344] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:29 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 1504 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:29.656225 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-901d4df0-88c0-495e-87b2-f9ce50ae5686 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:29.656836 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-901d4df0-88c0-495e-87b2-f9ce50ae5686 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:29.662787 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-901d4df0-88c0-495e-87b2-f9ce50ae5686 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:29.663268 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-901d4df0-88c0-495e-87b2-f9ce50ae5686 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:29.663706 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-901d4df0-88c0-495e-87b2-f9ce50ae5686 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:29.664422 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-901d4df0-88c0-495e-87b2-f9ce50ae5686 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:29.664878 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-901d4df0-88c0-495e-87b2-f9ce50ae5686 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:29.665307 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-901d4df0-88c0-495e-87b2-f9ce50ae5686 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:29.726093 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-901d4df0-88c0-495e-87b2-f9ce50ae5686 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:29.734575 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-901d4df0-88c0-495e-87b2-f9ce50ae5686 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1218 microversion: 2.1 time: 0.081346 Sep 21 12:23:29.735182 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 172/345] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:29 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:29.933570 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-090c47e1-6ce9-4dcc-a556-616c25213bb7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:29.934187 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-090c47e1-6ce9-4dcc-a556-616c25213bb7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:29.941258 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-090c47e1-6ce9-4dcc-a556-616c25213bb7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:29.941745 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-090c47e1-6ce9-4dcc-a556-616c25213bb7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:29.942191 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-090c47e1-6ce9-4dcc-a556-616c25213bb7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:29.942886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-090c47e1-6ce9-4dcc-a556-616c25213bb7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:29.943352 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-090c47e1-6ce9-4dcc-a556-616c25213bb7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:29.943808 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-090c47e1-6ce9-4dcc-a556-616c25213bb7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:30.077574 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-090c47e1-6ce9-4dcc-a556-616c25213bb7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:30.085819 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-090c47e1-6ce9-4dcc-a556-616c25213bb7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1322 microversion: 2.1 time: 0.155939 Sep 21 12:23:30.086392 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 174/346] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:29 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:30.286977 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-b8cd0af7-cad5-4e3e-989b-d52ce8637b5b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:30.287515 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-b8cd0af7-cad5-4e3e-989b-d52ce8637b5b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:30.293392 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b8cd0af7-cad5-4e3e-989b-d52ce8637b5b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:30.294405 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b8cd0af7-cad5-4e3e-989b-d52ce8637b5b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:30.294405 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b8cd0af7-cad5-4e3e-989b-d52ce8637b5b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:30.295129 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b8cd0af7-cad5-4e3e-989b-d52ce8637b5b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:30.295478 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b8cd0af7-cad5-4e3e-989b-d52ce8637b5b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:30.295935 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b8cd0af7-cad5-4e3e-989b-d52ce8637b5b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:30.423551 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-b8cd0af7-cad5-4e3e-989b-d52ce8637b5b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:30.431413 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-b8cd0af7-cad5-4e3e-989b-d52ce8637b5b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 200 len: 1504 microversion: 2.1 time: 0.148308 Sep 21 12:23:30.432022 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 173/347] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:30 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:30.757569 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-0f33c549-24a9-4fd1-bbde-615d3f7f462e tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:30.758188 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-0f33c549-24a9-4fd1-bbde-615d3f7f462e tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:30.764169 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0f33c549-24a9-4fd1-bbde-615d3f7f462e tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:30.765624 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0f33c549-24a9-4fd1-bbde-615d3f7f462e tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:30.765733 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0f33c549-24a9-4fd1-bbde-615d3f7f462e tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:30.766408 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0f33c549-24a9-4fd1-bbde-615d3f7f462e tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:30.766862 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0f33c549-24a9-4fd1-bbde-615d3f7f462e tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:30.767289 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0f33c549-24a9-4fd1-bbde-615d3f7f462e tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:30.825605 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-0f33c549-24a9-4fd1-bbde-615d3f7f462e tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:30.836491 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-0f33c549-24a9-4fd1-bbde-615d3f7f462e tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1218 microversion: 2.1 time: 0.082678 Sep 21 12:23:30.837197 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 175/348] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:30 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:31.108293 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-ac0e576a-3ead-4006-a7b4-a8609652b110 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:31.109536 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-ac0e576a-3ead-4006-a7b4-a8609652b110 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:31.112839 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell0:SELECT=6 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:31.113939 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell0:SELECT=22 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:31.118086 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ac0e576a-3ead-4006-a7b4-a8609652b110 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:31.118584 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ac0e576a-3ead-4006-a7b4-a8609652b110 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:31.119026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ac0e576a-3ead-4006-a7b4-a8609652b110 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:31.119844 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ac0e576a-3ead-4006-a7b4-a8609652b110 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:31.120217 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ac0e576a-3ead-4006-a7b4-a8609652b110 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:31.120653 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ac0e576a-3ead-4006-a7b4-a8609652b110 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:31.269392 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-ac0e576a-3ead-4006-a7b4-a8609652b110 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:31.280531 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-ac0e576a-3ead-4006-a7b4-a8609652b110 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1322 microversion: 2.1 time: 0.174264 Sep 21 12:23:31.281345 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 174/349] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:31 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:31.454148 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-08f161f6-36c3-47b4-901e-635db3a5b57c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:31.454769 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-08f161f6-36c3-47b4-901e-635db3a5b57c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:31.461624 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-08f161f6-36c3-47b4-901e-635db3a5b57c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:31.462197 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-08f161f6-36c3-47b4-901e-635db3a5b57c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:31.462719 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-08f161f6-36c3-47b4-901e-635db3a5b57c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:31.463516 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-08f161f6-36c3-47b4-901e-635db3a5b57c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:31.464135 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-08f161f6-36c3-47b4-901e-635db3a5b57c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:31.464662 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-08f161f6-36c3-47b4-901e-635db3a5b57c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:31.605290 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-08f161f6-36c3-47b4-901e-635db3a5b57c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:31.615004 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-08f161f6-36c3-47b4-901e-635db3a5b57c tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 200 len: 1504 microversion: 2.1 time: 0.164537 Sep 21 12:23:31.615573 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 176/350] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:31 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:31.861544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-a2fb4bcd-dfaa-4164-9345-efc927bc1075 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:31.862154 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-a2fb4bcd-dfaa-4164-9345-efc927bc1075 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:31.868181 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a2fb4bcd-dfaa-4164-9345-efc927bc1075 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:31.868662 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a2fb4bcd-dfaa-4164-9345-efc927bc1075 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:31.869096 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a2fb4bcd-dfaa-4164-9345-efc927bc1075 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:31.869788 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a2fb4bcd-dfaa-4164-9345-efc927bc1075 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:31.870241 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a2fb4bcd-dfaa-4164-9345-efc927bc1075 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:31.870664 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a2fb4bcd-dfaa-4164-9345-efc927bc1075 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:32.067254 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-a2fb4bcd-dfaa-4164-9345-efc927bc1075 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:32.075244 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-a2fb4bcd-dfaa-4164-9345-efc927bc1075 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1218 microversion: 2.1 time: 0.217530 Sep 21 12:23:32.075848 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 175/351] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:31 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1218 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:32.306288 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-c0fbcb9c-c5d3-4568-98b6-8b512726e90a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:32.306898 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-c0fbcb9c-c5d3-4568-98b6-8b512726e90a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:32.313304 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0fbcb9c-c5d3-4568-98b6-8b512726e90a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:32.313788 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0fbcb9c-c5d3-4568-98b6-8b512726e90a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:32.314226 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0fbcb9c-c5d3-4568-98b6-8b512726e90a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:32.314961 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0fbcb9c-c5d3-4568-98b6-8b512726e90a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:32.315367 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0fbcb9c-c5d3-4568-98b6-8b512726e90a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:32.315822 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0fbcb9c-c5d3-4568-98b6-8b512726e90a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:32.443367 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-c0fbcb9c-c5d3-4568-98b6-8b512726e90a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:32.450978 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-c0fbcb9c-c5d3-4568-98b6-8b512726e90a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1322 microversion: 2.1 time: 0.148607 Sep 21 12:23:32.451552 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 177/352] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:32 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:32.641530 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-e24b9eb1-c950-44ed-b719-c46921801b09 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:32.642044 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-e24b9eb1-c950-44ed-b719-c46921801b09 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:32.648252 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e24b9eb1-c950-44ed-b719-c46921801b09 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:32.648735 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e24b9eb1-c950-44ed-b719-c46921801b09 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:32.649174 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e24b9eb1-c950-44ed-b719-c46921801b09 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:32.649863 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e24b9eb1-c950-44ed-b719-c46921801b09 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:32.650312 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e24b9eb1-c950-44ed-b719-c46921801b09 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:32.650731 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e24b9eb1-c950-44ed-b719-c46921801b09 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:32.782547 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-e24b9eb1-c950-44ed-b719-c46921801b09 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:32.790043 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-e24b9eb1-c950-44ed-b719-c46921801b09 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 200 len: 1504 microversion: 2.1 time: 0.152519 Sep 21 12:23:32.790601 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 176/353] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:32 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:33.098418 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-6854597b-b739-45cd-8b09-0bf6466399bf tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:33.099033 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-6854597b-b739-45cd-8b09-0bf6466399bf tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:33.105496 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6854597b-b739-45cd-8b09-0bf6466399bf tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:33.105983 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6854597b-b739-45cd-8b09-0bf6466399bf tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:33.106418 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6854597b-b739-45cd-8b09-0bf6466399bf tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:33.107117 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6854597b-b739-45cd-8b09-0bf6466399bf tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:33.107576 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6854597b-b739-45cd-8b09-0bf6466399bf tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:33.108042 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6854597b-b739-45cd-8b09-0bf6466399bf tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:33.169461 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-6854597b-b739-45cd-8b09-0bf6466399bf tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:33.177788 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-6854597b-b739-45cd-8b09-0bf6466399bf tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1218 microversion: 2.1 time: 0.083208 Sep 21 12:23:33.178360 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 178/354] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:33 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:33.475076 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-0b90b030-cfd0-42fa-8e32-6682f1198b48 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:33.475590 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-0b90b030-cfd0-42fa-8e32-6682f1198b48 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:33.481559 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0b90b030-cfd0-42fa-8e32-6682f1198b48 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:33.482050 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0b90b030-cfd0-42fa-8e32-6682f1198b48 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:33.482485 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0b90b030-cfd0-42fa-8e32-6682f1198b48 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:33.483179 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0b90b030-cfd0-42fa-8e32-6682f1198b48 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:33.483634 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0b90b030-cfd0-42fa-8e32-6682f1198b48 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:33.484089 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0b90b030-cfd0-42fa-8e32-6682f1198b48 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:33.616776 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-0b90b030-cfd0-42fa-8e32-6682f1198b48 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:33.624429 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-0b90b030-cfd0-42fa-8e32-6682f1198b48 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1322 microversion: 2.1 time: 0.153234 Sep 21 12:23:33.624955 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 177/355] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:33 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:33.813091 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-2ac29127-de6d-4034-a224-305f5134227b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:33.813714 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-2ac29127-de6d-4034-a224-305f5134227b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:33.819897 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2ac29127-de6d-4034-a224-305f5134227b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:33.820394 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2ac29127-de6d-4034-a224-305f5134227b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:33.820863 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2ac29127-de6d-4034-a224-305f5134227b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:33.821594 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2ac29127-de6d-4034-a224-305f5134227b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:33.822054 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2ac29127-de6d-4034-a224-305f5134227b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:33.822486 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2ac29127-de6d-4034-a224-305f5134227b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:33.966887 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-2ac29127-de6d-4034-a224-305f5134227b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:33.974977 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-2ac29127-de6d-4034-a224-305f5134227b tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 200 len: 1504 microversion: 2.1 time: 0.166213 Sep 21 12:23:33.975562 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 179/356] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:33 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:34.200456 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-dd70dde3-9acb-458d-9e07-e3d15a510abb tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:34.201072 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-dd70dde3-9acb-458d-9e07-e3d15a510abb tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:34.207329 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dd70dde3-9acb-458d-9e07-e3d15a510abb tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:34.207833 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dd70dde3-9acb-458d-9e07-e3d15a510abb tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:34.208276 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dd70dde3-9acb-458d-9e07-e3d15a510abb tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:34.208965 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dd70dde3-9acb-458d-9e07-e3d15a510abb tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:34.209423 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dd70dde3-9acb-458d-9e07-e3d15a510abb tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:34.209855 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dd70dde3-9acb-458d-9e07-e3d15a510abb tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:34.277525 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-dd70dde3-9acb-458d-9e07-e3d15a510abb tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:34.285484 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-dd70dde3-9acb-458d-9e07-e3d15a510abb tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1218 microversion: 2.1 time: 0.088796 Sep 21 12:23:34.286066 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 178/357] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:34 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:34.649673 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-7a38dbda-a678-4017-9d1e-fa986fea8d5b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:34.650282 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-7a38dbda-a678-4017-9d1e-fa986fea8d5b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:34.657195 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7a38dbda-a678-4017-9d1e-fa986fea8d5b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:34.657678 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7a38dbda-a678-4017-9d1e-fa986fea8d5b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:34.658106 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7a38dbda-a678-4017-9d1e-fa986fea8d5b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:34.658785 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7a38dbda-a678-4017-9d1e-fa986fea8d5b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:34.659232 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7a38dbda-a678-4017-9d1e-fa986fea8d5b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:34.659653 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7a38dbda-a678-4017-9d1e-fa986fea8d5b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:34.798921 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-7a38dbda-a678-4017-9d1e-fa986fea8d5b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:34.806515 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-7a38dbda-a678-4017-9d1e-fa986fea8d5b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1322 microversion: 2.1 time: 0.160703 Sep 21 12:23:34.807087 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 180/358] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:34 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:34.997681 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-ff4950cd-9a38-4fe7-923d-bd40174f75a1 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:34.998293 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-ff4950cd-9a38-4fe7-923d-bd40174f75a1 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:35.004323 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ff4950cd-9a38-4fe7-923d-bd40174f75a1 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:35.004801 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ff4950cd-9a38-4fe7-923d-bd40174f75a1 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:35.005230 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ff4950cd-9a38-4fe7-923d-bd40174f75a1 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:35.005915 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ff4950cd-9a38-4fe7-923d-bd40174f75a1 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:35.006367 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ff4950cd-9a38-4fe7-923d-bd40174f75a1 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:35.006785 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ff4950cd-9a38-4fe7-923d-bd40174f75a1 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:35.136621 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-ff4950cd-9a38-4fe7-923d-bd40174f75a1 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:35.139047 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=100 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:35.146292 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-ff4950cd-9a38-4fe7-923d-bd40174f75a1 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 200 len: 1504 microversion: 2.1 time: 0.152356 Sep 21 12:23:35.159811 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 179/359] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:34 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:35.160281 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-79108752-fad1-48b0-87bd-5a562d7350a1 req-ce4d62c5-9c4c-46da-8bbc-0472d1f1c6c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5560ddde-2668-4e31-bbbf-b94d7485df5a", "name": "network-vif-plugged", "status": "completed", "tag": "3fb9b2d0-df9a-421a-b7da-b2bbf6f67639"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:23:35.165215 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-79108752-fad1-48b0-87bd-5a562d7350a1 req-ce4d62c5-9c4c-46da-8bbc-0472d1f1c6c4 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:35.165875 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-79108752-fad1-48b0-87bd-5a562d7350a1 req-ce4d62c5-9c4c-46da-8bbc-0472d1f1c6c4 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:35.166380 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-79108752-fad1-48b0-87bd-5a562d7350a1 req-ce4d62c5-9c4c-46da-8bbc-0472d1f1c6c4 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:35.178614 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-79108752-fad1-48b0-87bd-5a562d7350a1 req-ce4d62c5-9c4c-46da-8bbc-0472d1f1c6c4 service nova] Creating event network-vif-plugged:3fb9b2d0-df9a-421a-b7da-b2bbf6f67639 for instance 5560ddde-2668-4e31-bbbf-b94d7485df5a on hv-cinder-85867 Sep 21 12:23:35.183625 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-79108752-fad1-48b0-87bd-5a562d7350a1 req-ce4d62c5-9c4c-46da-8bbc-0472d1f1c6c4 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035701 Sep 21 12:23:35.184262 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 181/360] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 12:23:35.308262 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-a3f06bf3-15c4-4a79-a759-25de5e7ce98a tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:35.308914 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-a3f06bf3-15c4-4a79-a759-25de5e7ce98a tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:35.315820 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a3f06bf3-15c4-4a79-a759-25de5e7ce98a tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:35.316335 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a3f06bf3-15c4-4a79-a759-25de5e7ce98a tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:35.316798 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a3f06bf3-15c4-4a79-a759-25de5e7ce98a tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:35.317497 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a3f06bf3-15c4-4a79-a759-25de5e7ce98a tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:35.318010 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a3f06bf3-15c4-4a79-a759-25de5e7ce98a tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:35.318432 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a3f06bf3-15c4-4a79-a759-25de5e7ce98a tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:35.383160 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-a3f06bf3-15c4-4a79-a759-25de5e7ce98a tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:35.391356 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-a3f06bf3-15c4-4a79-a759-25de5e7ce98a tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1218 microversion: 2.1 time: 0.086989 Sep 21 12:23:35.391937 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 180/361] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:35 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:35.829559 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-a4bbd389-9109-4ec4-83e4-321fa8c671ad tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:35.830553 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-a4bbd389-9109-4ec4-83e4-321fa8c671ad tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:35.837196 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a4bbd389-9109-4ec4-83e4-321fa8c671ad tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:35.837689 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a4bbd389-9109-4ec4-83e4-321fa8c671ad tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:35.838131 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a4bbd389-9109-4ec4-83e4-321fa8c671ad tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:35.838825 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a4bbd389-9109-4ec4-83e4-321fa8c671ad tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:35.839285 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a4bbd389-9109-4ec4-83e4-321fa8c671ad tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:35.839716 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a4bbd389-9109-4ec4-83e4-321fa8c671ad tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:35.968224 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a4bbd389-9109-4ec4-83e4-321fa8c671ad tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:35.975802 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-a4bbd389-9109-4ec4-83e4-321fa8c671ad tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1322 microversion: 2.1 time: 0.150450 Sep 21 12:23:35.976374 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 182/362] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:35 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:36.170502 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-132de12c-ee00-4a9d-b11c-a06a905f0734 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:36.171702 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-132de12c-ee00-4a9d-b11c-a06a905f0734 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:36.177666 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-132de12c-ee00-4a9d-b11c-a06a905f0734 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:36.178152 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-132de12c-ee00-4a9d-b11c-a06a905f0734 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:36.178591 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-132de12c-ee00-4a9d-b11c-a06a905f0734 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:36.179281 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-132de12c-ee00-4a9d-b11c-a06a905f0734 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:36.179738 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-132de12c-ee00-4a9d-b11c-a06a905f0734 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:36.180192 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-132de12c-ee00-4a9d-b11c-a06a905f0734 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:36.310292 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-132de12c-ee00-4a9d-b11c-a06a905f0734 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:36.317998 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-132de12c-ee00-4a9d-b11c-a06a905f0734 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 200 len: 1504 microversion: 2.1 time: 0.151377 Sep 21 12:23:36.318566 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 181/363] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:36 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:36.414304 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-ad6ae04a-d776-4ef5-a472-dee650bc731b tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:36.414940 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-ad6ae04a-d776-4ef5-a472-dee650bc731b tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:36.421669 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ad6ae04a-d776-4ef5-a472-dee650bc731b tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:36.422097 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ad6ae04a-d776-4ef5-a472-dee650bc731b tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:36.422535 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ad6ae04a-d776-4ef5-a472-dee650bc731b tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:36.423298 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ad6ae04a-d776-4ef5-a472-dee650bc731b tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:36.426363 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ad6ae04a-d776-4ef5-a472-dee650bc731b tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:36.426832 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ad6ae04a-d776-4ef5-a472-dee650bc731b tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:36.511289 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-ad6ae04a-d776-4ef5-a472-dee650bc731b tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:36.521471 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-ad6ae04a-d776-4ef5-a472-dee650bc731b tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1218 microversion: 2.1 time: 0.111190 Sep 21 12:23:36.522291 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 183/364] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:36 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:36.998562 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-7a998e90-d9e2-4347-b9a5-0cd001a2f5ce tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:36.999600 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-7a998e90-d9e2-4347-b9a5-0cd001a2f5ce tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:37.005570 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7a998e90-d9e2-4347-b9a5-0cd001a2f5ce tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:37.006063 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7a998e90-d9e2-4347-b9a5-0cd001a2f5ce tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:37.006504 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7a998e90-d9e2-4347-b9a5-0cd001a2f5ce tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:37.007193 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7a998e90-d9e2-4347-b9a5-0cd001a2f5ce tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:37.007649 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7a998e90-d9e2-4347-b9a5-0cd001a2f5ce tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:37.008116 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7a998e90-d9e2-4347-b9a5-0cd001a2f5ce tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:37.139889 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-7a998e90-d9e2-4347-b9a5-0cd001a2f5ce tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:37.147493 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-7a998e90-d9e2-4347-b9a5-0cd001a2f5ce tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1322 microversion: 2.1 time: 0.152873 Sep 21 12:23:37.148087 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 182/365] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:36 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:37.341880 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-9340652c-6b50-44a8-9545-346c9e3416f7 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:37.342518 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-9340652c-6b50-44a8-9545-346c9e3416f7 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:37.349357 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9340652c-6b50-44a8-9545-346c9e3416f7 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:37.349846 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9340652c-6b50-44a8-9545-346c9e3416f7 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:37.350287 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9340652c-6b50-44a8-9545-346c9e3416f7 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:37.350984 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9340652c-6b50-44a8-9545-346c9e3416f7 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:37.351493 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9340652c-6b50-44a8-9545-346c9e3416f7 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:37.351969 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9340652c-6b50-44a8-9545-346c9e3416f7 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:37.485849 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-9340652c-6b50-44a8-9545-346c9e3416f7 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:37.493497 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-9340652c-6b50-44a8-9545-346c9e3416f7 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 200 len: 1504 microversion: 2.1 time: 0.155650 Sep 21 12:23:37.494095 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 184/366] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:37 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:37.544979 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-c1539d11-44e2-4241-90ca-8068c9919961 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:37.545555 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-c1539d11-44e2-4241-90ca-8068c9919961 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:37.552091 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c1539d11-44e2-4241-90ca-8068c9919961 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:37.552573 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c1539d11-44e2-4241-90ca-8068c9919961 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:37.553005 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c1539d11-44e2-4241-90ca-8068c9919961 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:37.553696 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c1539d11-44e2-4241-90ca-8068c9919961 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:37.554144 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c1539d11-44e2-4241-90ca-8068c9919961 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:37.554596 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c1539d11-44e2-4241-90ca-8068c9919961 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:37.615336 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-c1539d11-44e2-4241-90ca-8068c9919961 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:37.622995 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-c1539d11-44e2-4241-90ca-8068c9919961 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1266 microversion: 2.1 time: 0.081836 Sep 21 12:23:37.623554 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 183/367] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:37 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:38.170491 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-cef62c50-98b7-4392-b5d0-b1974637dbb0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:38.171140 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-cef62c50-98b7-4392-b5d0-b1974637dbb0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:38.177080 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cef62c50-98b7-4392-b5d0-b1974637dbb0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:38.177561 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cef62c50-98b7-4392-b5d0-b1974637dbb0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:38.177996 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cef62c50-98b7-4392-b5d0-b1974637dbb0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:38.178742 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cef62c50-98b7-4392-b5d0-b1974637dbb0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:38.179195 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cef62c50-98b7-4392-b5d0-b1974637dbb0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:38.179619 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cef62c50-98b7-4392-b5d0-b1974637dbb0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:38.307013 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-cef62c50-98b7-4392-b5d0-b1974637dbb0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:38.315202 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-cef62c50-98b7-4392-b5d0-b1974637dbb0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1322 microversion: 2.1 time: 0.148581 Sep 21 12:23:38.315795 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 185/368] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:38 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:38.517535 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-a57e03be-a488-4932-b7e7-adf2cd5bc143 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:38.518082 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-a57e03be-a488-4932-b7e7-adf2cd5bc143 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:38.524017 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a57e03be-a488-4932-b7e7-adf2cd5bc143 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:38.524500 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a57e03be-a488-4932-b7e7-adf2cd5bc143 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:38.524929 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a57e03be-a488-4932-b7e7-adf2cd5bc143 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:38.525613 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a57e03be-a488-4932-b7e7-adf2cd5bc143 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:38.526060 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a57e03be-a488-4932-b7e7-adf2cd5bc143 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:38.526481 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a57e03be-a488-4932-b7e7-adf2cd5bc143 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:38.645749 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-eb84f72b-7655-4264-bb79-99dc6a2abd65 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:38.646375 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-eb84f72b-7655-4264-bb79-99dc6a2abd65 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:38.652636 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eb84f72b-7655-4264-bb79-99dc6a2abd65 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:38.653132 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eb84f72b-7655-4264-bb79-99dc6a2abd65 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:38.653573 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eb84f72b-7655-4264-bb79-99dc6a2abd65 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:38.654272 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eb84f72b-7655-4264-bb79-99dc6a2abd65 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:38.654734 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eb84f72b-7655-4264-bb79-99dc6a2abd65 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:38.655215 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eb84f72b-7655-4264-bb79-99dc6a2abd65 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:38.667240 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-a57e03be-a488-4932-b7e7-adf2cd5bc143 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:38.675692 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-a57e03be-a488-4932-b7e7-adf2cd5bc143 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 200 len: 1504 microversion: 2.1 time: 0.162429 Sep 21 12:23:38.687946 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 184/369] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:38 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:23:38.747017 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-eb84f72b-7655-4264-bb79-99dc6a2abd65 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:38.755459 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-eb84f72b-7655-4264-bb79-99dc6a2abd65 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1266 microversion: 2.1 time: 0.113569 Sep 21 12:23:38.756056 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 186/370] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:38 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1266 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:23:39.338032 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-e0fdd8e4-39d6-41b7-9c98-9ecc35f6636e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:39.338741 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-e0fdd8e4-39d6-41b7-9c98-9ecc35f6636e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:39.345285 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e0fdd8e4-39d6-41b7-9c98-9ecc35f6636e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:39.345757 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e0fdd8e4-39d6-41b7-9c98-9ecc35f6636e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:39.346185 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e0fdd8e4-39d6-41b7-9c98-9ecc35f6636e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:39.346865 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e0fdd8e4-39d6-41b7-9c98-9ecc35f6636e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:39.347310 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e0fdd8e4-39d6-41b7-9c98-9ecc35f6636e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:39.347773 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e0fdd8e4-39d6-41b7-9c98-9ecc35f6636e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:39.476336 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-e0fdd8e4-39d6-41b7-9c98-9ecc35f6636e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:39.484674 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-e0fdd8e4-39d6-41b7-9c98-9ecc35f6636e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1322 microversion: 2.1 time: 0.150469 Sep 21 12:23:39.485238 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 185/371] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:39 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:39.701409 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-32844076-b9f2-4992-8a58-83348470c128 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:39.702862 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-32844076-b9f2-4992-8a58-83348470c128 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:39.715351 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-32844076-b9f2-4992-8a58-83348470c128 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:39.715884 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-32844076-b9f2-4992-8a58-83348470c128 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:39.716455 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-32844076-b9f2-4992-8a58-83348470c128 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:39.717191 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-32844076-b9f2-4992-8a58-83348470c128 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:39.718859 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-32844076-b9f2-4992-8a58-83348470c128 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:39.721273 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-32844076-b9f2-4992-8a58-83348470c128 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:39.788964 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-521246d6-8946-4e22-9237-763fdd2c2153 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:39.791229 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-521246d6-8946-4e22-9237-763fdd2c2153 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:39.805045 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-521246d6-8946-4e22-9237-763fdd2c2153 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:39.805446 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-521246d6-8946-4e22-9237-763fdd2c2153 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:39.808390 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-521246d6-8946-4e22-9237-763fdd2c2153 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:39.812204 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-521246d6-8946-4e22-9237-763fdd2c2153 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:39.813971 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-521246d6-8946-4e22-9237-763fdd2c2153 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:39.814477 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-521246d6-8946-4e22-9237-763fdd2c2153 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:39.929188 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-521246d6-8946-4e22-9237-763fdd2c2153 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:39.944756 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-521246d6-8946-4e22-9237-763fdd2c2153 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1274 microversion: 2.1 time: 0.170018 Sep 21 12:23:39.945626 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 186/372] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:39 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1274 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:39.970342 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-7d743e50-5e5e-4255-a272-e16a1b00beec req-7718e72f-8a6d-4c38-90fc-22f831024e5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de0f1a98-9419-4e35-b8e0-520c7fc482fb", "name": "network-vif-plugged", "status": "completed", "tag": "16f7d649-433e-42b0-aede-b34b15fd092f"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:23:40.021881 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-7d743e50-5e5e-4255-a272-e16a1b00beec req-7718e72f-8a6d-4c38-90fc-22f831024e5a service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:40.022946 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-32844076-b9f2-4992-8a58-83348470c128 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:40.032591 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-7d743e50-5e5e-4255-a272-e16a1b00beec req-7718e72f-8a6d-4c38-90fc-22f831024e5a service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:40.033037 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-7d743e50-5e5e-4255-a272-e16a1b00beec req-7718e72f-8a6d-4c38-90fc-22f831024e5a service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:40.046012 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-32844076-b9f2-4992-8a58-83348470c128 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 200 len: 1504 microversion: 2.1 time: 0.348631 Sep 21 12:23:40.047113 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 187/373] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:39 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 1504 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:40.061582 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-7d743e50-5e5e-4255-a272-e16a1b00beec req-7718e72f-8a6d-4c38-90fc-22f831024e5a service nova] Creating event network-vif-plugged:16f7d649-433e-42b0-aede-b34b15fd092f for instance de0f1a98-9419-4e35-b8e0-520c7fc482fb on hv-cinder-85867 Sep 21 12:23:40.067354 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-7d743e50-5e5e-4255-a272-e16a1b00beec req-7718e72f-8a6d-4c38-90fc-22f831024e5a service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104470 Sep 21 12:23:40.071011 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 187/374] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 12:23:40.275129 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-6b6207f3-6eb7-417a-8d69-ccfa0f5d9a1c req-0ef63983-dd33-4171-bc7f-aecd6bb651d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "309d01e5-d152-40c7-bbe0-db2292d5f103", "name": "network-vif-deleted", "tag": "31c51ceb-171d-4706-b582-46630abdaa5b"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:23:40.288544 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-6b6207f3-6eb7-417a-8d69-ccfa0f5d9a1c req-0ef63983-dd33-4171-bc7f-aecd6bb651d9 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:40.289040 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-6b6207f3-6eb7-417a-8d69-ccfa0f5d9a1c req-0ef63983-dd33-4171-bc7f-aecd6bb651d9 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:40.289477 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-6b6207f3-6eb7-417a-8d69-ccfa0f5d9a1c req-0ef63983-dd33-4171-bc7f-aecd6bb651d9 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:40.301710 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-6b6207f3-6eb7-417a-8d69-ccfa0f5d9a1c req-0ef63983-dd33-4171-bc7f-aecd6bb651d9 service nova] Creating event network-vif-deleted:31c51ceb-171d-4706-b582-46630abdaa5b for instance 309d01e5-d152-40c7-bbe0-db2292d5f103 on hv-cinder-85867 Sep 21 12:23:40.307884 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-6b6207f3-6eb7-417a-8d69-ccfa0f5d9a1c req-0ef63983-dd33-4171-bc7f-aecd6bb651d9 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035838 Sep 21 12:23:40.308965 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 188/375] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:23:40.508296 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-79f35d43-a904-43ac-ab5f-d9bb114c5e33 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:40.509219 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-79f35d43-a904-43ac-ab5f-d9bb114c5e33 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:40.523264 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-79f35d43-a904-43ac-ab5f-d9bb114c5e33 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:40.523745 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-79f35d43-a904-43ac-ab5f-d9bb114c5e33 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:40.524229 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-79f35d43-a904-43ac-ab5f-d9bb114c5e33 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:40.524927 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-79f35d43-a904-43ac-ab5f-d9bb114c5e33 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:40.525375 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-79f35d43-a904-43ac-ab5f-d9bb114c5e33 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:40.525794 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-79f35d43-a904-43ac-ab5f-d9bb114c5e33 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:40.777885 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-79f35d43-a904-43ac-ab5f-d9bb114c5e33 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:40.786101 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-79f35d43-a904-43ac-ab5f-d9bb114c5e33 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1322 microversion: 2.1 time: 0.282376 Sep 21 12:23:40.786753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 188/376] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:40 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1322 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:40.970409 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-62850253-7e90-41a9-be74-40a353cf64ee tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:40.971210 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-62850253-7e90-41a9-be74-40a353cf64ee tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:40.977662 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-62850253-7e90-41a9-be74-40a353cf64ee tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:40.978181 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-62850253-7e90-41a9-be74-40a353cf64ee tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:40.978701 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-62850253-7e90-41a9-be74-40a353cf64ee tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:40.979467 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-62850253-7e90-41a9-be74-40a353cf64ee tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:40.980030 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-62850253-7e90-41a9-be74-40a353cf64ee tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:40.980552 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-62850253-7e90-41a9-be74-40a353cf64ee tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:41.044734 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-62850253-7e90-41a9-be74-40a353cf64ee tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:41.052515 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-62850253-7e90-41a9-be74-40a353cf64ee tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1272 microversion: 2.1 time: 0.087479 Sep 21 12:23:41.053097 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 189/377] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:40 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1272 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:41.070652 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-75074c77-56af-4701-a962-787296e44ee6 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:41.071262 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-75074c77-56af-4701-a962-787296e44ee6 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:41.078155 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-75074c77-56af-4701-a962-787296e44ee6 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:41.078666 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-75074c77-56af-4701-a962-787296e44ee6 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:41.079066 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-75074c77-56af-4701-a962-787296e44ee6 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:41.079764 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-75074c77-56af-4701-a962-787296e44ee6 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:41.080504 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-75074c77-56af-4701-a962-787296e44ee6 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:41.080919 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-75074c77-56af-4701-a962-787296e44ee6 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:41.114175 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-75074c77-56af-4701-a962-787296e44ee6 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:41.114652 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-75074c77-56af-4701-a962-787296e44ee6 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:41.115086 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-75074c77-56af-4701-a962-787296e44ee6 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:41.115533 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.objects.instance [None req-75074c77-56af-4701-a962-787296e44ee6 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lazy-loading 'fault' on Instance uuid 309d01e5-d152-40c7-bbe0-db2292d5f103 {{(pid=120462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 12:23:41.170909 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-75074c77-56af-4701-a962-787296e44ee6 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:41.178627 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-75074c77-56af-4701-a962-787296e44ee6 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 200 len: 1304 microversion: 2.1 time: 0.111894 Sep 21 12:23:41.179631 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 189/378] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:41 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:41.809759 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-dbf5e6a6-df15-4667-b8b7-d31c9edc4a8c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:41.810377 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-dbf5e6a6-df15-4667-b8b7-d31c9edc4a8c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:41.817099 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dbf5e6a6-df15-4667-b8b7-d31c9edc4a8c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:41.817585 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dbf5e6a6-df15-4667-b8b7-d31c9edc4a8c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:41.818026 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dbf5e6a6-df15-4667-b8b7-d31c9edc4a8c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:41.818724 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dbf5e6a6-df15-4667-b8b7-d31c9edc4a8c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:41.819214 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dbf5e6a6-df15-4667-b8b7-d31c9edc4a8c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:41.819644 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dbf5e6a6-df15-4667-b8b7-d31c9edc4a8c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:41.823819 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=100 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:41.952742 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-dbf5e6a6-df15-4667-b8b7-d31c9edc4a8c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:41.960539 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-dbf5e6a6-df15-4667-b8b7-d31c9edc4a8c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1322 microversion: 2.1 time: 0.154671 Sep 21 12:23:41.961102 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 190/379] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:41 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:42.076807 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-e34f069a-b18d-45de-9660-6bad5c8606bb tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:42.078214 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-e34f069a-b18d-45de-9660-6bad5c8606bb tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:42.085151 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e34f069a-b18d-45de-9660-6bad5c8606bb tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:42.086371 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e34f069a-b18d-45de-9660-6bad5c8606bb tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:42.086997 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e34f069a-b18d-45de-9660-6bad5c8606bb tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:42.087903 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e34f069a-b18d-45de-9660-6bad5c8606bb tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:42.088370 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e34f069a-b18d-45de-9660-6bad5c8606bb tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:42.088966 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e34f069a-b18d-45de-9660-6bad5c8606bb tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:42.202724 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-0fa16983-cf89-4dbc-8ba5-ab942809c449 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:42.203483 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-0fa16983-cf89-4dbc-8ba5-ab942809c449 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:42.210285 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0fa16983-cf89-4dbc-8ba5-ab942809c449 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:42.210774 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0fa16983-cf89-4dbc-8ba5-ab942809c449 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:42.211222 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0fa16983-cf89-4dbc-8ba5-ab942809c449 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:42.211955 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0fa16983-cf89-4dbc-8ba5-ab942809c449 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:42.212419 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0fa16983-cf89-4dbc-8ba5-ab942809c449 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:42.212848 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0fa16983-cf89-4dbc-8ba5-ab942809c449 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:42.245229 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0fa16983-cf89-4dbc-8ba5-ab942809c449 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:42.245718 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0fa16983-cf89-4dbc-8ba5-ab942809c449 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:42.246159 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0fa16983-cf89-4dbc-8ba5-ab942809c449 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:42.246655 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.objects.instance [None req-0fa16983-cf89-4dbc-8ba5-ab942809c449 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lazy-loading 'fault' on Instance uuid 309d01e5-d152-40c7-bbe0-db2292d5f103 {{(pid=120463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 12:23:42.287274 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-0fa16983-cf89-4dbc-8ba5-ab942809c449 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:42.294904 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-0fa16983-cf89-4dbc-8ba5-ab942809c449 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 200 len: 1304 microversion: 2.1 time: 0.096043 Sep 21 12:23:42.307780 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 191/380] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:42 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:23:42.328105 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-e34f069a-b18d-45de-9660-6bad5c8606bb tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:42.336307 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-e34f069a-b18d-45de-9660-6bad5c8606bb tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1314 microversion: 2.1 time: 0.263714 Sep 21 12:23:42.336885 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 190/381] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:42 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:42.707527 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-61fc4c10-a42d-4c12-979b-b2a78b2bd378 req-e4985181-2471-4d97-9807-0c621608acad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "714df43c-52c2-426d-a391-bf58f3fa2584", "tag": "77262639-075d-4f0b-8e2b-dee03a44e539"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:23:42.717742 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-61fc4c10-a42d-4c12-979b-b2a78b2bd378 req-e4985181-2471-4d97-9807-0c621608acad service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:42.717742 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-61fc4c10-a42d-4c12-979b-b2a78b2bd378 req-e4985181-2471-4d97-9807-0c621608acad service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:42.717742 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-61fc4c10-a42d-4c12-979b-b2a78b2bd378 req-e4985181-2471-4d97-9807-0c621608acad service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:42.730836 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-61fc4c10-a42d-4c12-979b-b2a78b2bd378 req-e4985181-2471-4d97-9807-0c621608acad service nova] Creating event network-changed:77262639-075d-4f0b-8e2b-dee03a44e539 for instance 714df43c-52c2-426d-a391-bf58f3fa2584 on hv-cinder-85867 Sep 21 12:23:42.736191 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-61fc4c10-a42d-4c12-979b-b2a78b2bd378 req-e4985181-2471-4d97-9807-0c621608acad service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032503 Sep 21 12:23:42.736792 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 192/382] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:23:42.984548 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-84d88148-07f2-4b0c-927f-8ef5b07898d5 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:42.985155 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-84d88148-07f2-4b0c-927f-8ef5b07898d5 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:42.991119 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-84d88148-07f2-4b0c-927f-8ef5b07898d5 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:42.991592 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-84d88148-07f2-4b0c-927f-8ef5b07898d5 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:42.992057 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-84d88148-07f2-4b0c-927f-8ef5b07898d5 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:42.992746 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-84d88148-07f2-4b0c-927f-8ef5b07898d5 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:42.993183 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-84d88148-07f2-4b0c-927f-8ef5b07898d5 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:42.993605 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-84d88148-07f2-4b0c-927f-8ef5b07898d5 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:43.120423 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-84d88148-07f2-4b0c-927f-8ef5b07898d5 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:43.128700 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-84d88148-07f2-4b0c-927f-8ef5b07898d5 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1322 microversion: 2.1 time: 0.147970 Sep 21 12:23:43.129283 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 191/383] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:42 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:43.319084 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-199674f0-f07f-4a77-bcee-e087f09a72dd tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:43.319808 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-199674f0-f07f-4a77-bcee-e087f09a72dd tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:43.326426 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-199674f0-f07f-4a77-bcee-e087f09a72dd tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:43.326916 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-199674f0-f07f-4a77-bcee-e087f09a72dd tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:43.327362 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-199674f0-f07f-4a77-bcee-e087f09a72dd tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:43.328081 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-199674f0-f07f-4a77-bcee-e087f09a72dd tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:43.328543 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-199674f0-f07f-4a77-bcee-e087f09a72dd tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:43.328972 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-199674f0-f07f-4a77-bcee-e087f09a72dd tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:43.360287 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-199674f0-f07f-4a77-bcee-e087f09a72dd tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:43.360489 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-4b516d33-fd88-4a50-ab5f-6e12c4547878 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:43.360775 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-199674f0-f07f-4a77-bcee-e087f09a72dd tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:43.360889 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-4b516d33-fd88-4a50-ab5f-6e12c4547878 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:43.361216 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-199674f0-f07f-4a77-bcee-e087f09a72dd tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:43.361666 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.objects.instance [None req-199674f0-f07f-4a77-bcee-e087f09a72dd tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lazy-loading 'fault' on Instance uuid 309d01e5-d152-40c7-bbe0-db2292d5f103 {{(pid=120463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 12:23:43.366665 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4b516d33-fd88-4a50-ab5f-6e12c4547878 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:43.367149 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4b516d33-fd88-4a50-ab5f-6e12c4547878 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:43.367583 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4b516d33-fd88-4a50-ab5f-6e12c4547878 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:43.368308 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4b516d33-fd88-4a50-ab5f-6e12c4547878 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:43.368767 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4b516d33-fd88-4a50-ab5f-6e12c4547878 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:43.369191 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4b516d33-fd88-4a50-ab5f-6e12c4547878 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:43.405064 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-199674f0-f07f-4a77-bcee-e087f09a72dd tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:43.412919 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-199674f0-f07f-4a77-bcee-e087f09a72dd tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 200 len: 1304 microversion: 2.1 time: 0.097927 Sep 21 12:23:43.413433 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 193/384] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:43 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:43.510209 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-4b516d33-fd88-4a50-ab5f-6e12c4547878 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:43.517801 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-4b516d33-fd88-4a50-ab5f-6e12c4547878 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1314 microversion: 2.1 time: 0.161889 Sep 21 12:23:43.518363 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 192/385] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:43 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:44.151734 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-51d2966d-7fb5-46a3-8c78-a97e1cb96678 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:44.152375 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-51d2966d-7fb5-46a3-8c78-a97e1cb96678 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:44.158946 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-51d2966d-7fb5-46a3-8c78-a97e1cb96678 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:44.159431 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-51d2966d-7fb5-46a3-8c78-a97e1cb96678 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:44.159897 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-51d2966d-7fb5-46a3-8c78-a97e1cb96678 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:44.160581 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-51d2966d-7fb5-46a3-8c78-a97e1cb96678 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:44.161038 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-51d2966d-7fb5-46a3-8c78-a97e1cb96678 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:44.161465 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-51d2966d-7fb5-46a3-8c78-a97e1cb96678 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:44.289613 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-51d2966d-7fb5-46a3-8c78-a97e1cb96678 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:44.297227 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-51d2966d-7fb5-46a3-8c78-a97e1cb96678 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1322 microversion: 2.1 time: 0.149381 Sep 21 12:23:44.297794 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 194/386] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:44 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:44.439246 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-b47ad197-4c87-4383-865d-08a07b0807bb tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:44.439794 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-b47ad197-4c87-4383-865d-08a07b0807bb tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:44.445760 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b47ad197-4c87-4383-865d-08a07b0807bb tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:44.446249 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b47ad197-4c87-4383-865d-08a07b0807bb tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:44.446689 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b47ad197-4c87-4383-865d-08a07b0807bb tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:44.447381 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b47ad197-4c87-4383-865d-08a07b0807bb tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:44.447876 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b47ad197-4c87-4383-865d-08a07b0807bb tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:44.448307 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b47ad197-4c87-4383-865d-08a07b0807bb tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:44.480297 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b47ad197-4c87-4383-865d-08a07b0807bb tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:44.480811 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b47ad197-4c87-4383-865d-08a07b0807bb tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:44.481248 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b47ad197-4c87-4383-865d-08a07b0807bb tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:44.481719 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.objects.instance [None req-b47ad197-4c87-4383-865d-08a07b0807bb tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lazy-loading 'fault' on Instance uuid 309d01e5-d152-40c7-bbe0-db2292d5f103 {{(pid=120462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 12:23:44.521838 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-b47ad197-4c87-4383-865d-08a07b0807bb tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:44.529297 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-b47ad197-4c87-4383-865d-08a07b0807bb tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 200 len: 1304 microversion: 2.1 time: 0.094633 Sep 21 12:23:44.529913 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 193/387] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:44 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:44.540277 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-40df6188-2554-4fa3-b216-19d83df0c565 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:44.540929 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-40df6188-2554-4fa3-b216-19d83df0c565 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:44.547404 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-40df6188-2554-4fa3-b216-19d83df0c565 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:44.547928 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-40df6188-2554-4fa3-b216-19d83df0c565 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:44.548374 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-40df6188-2554-4fa3-b216-19d83df0c565 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:44.549076 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-40df6188-2554-4fa3-b216-19d83df0c565 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:44.549539 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-40df6188-2554-4fa3-b216-19d83df0c565 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:44.549974 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-40df6188-2554-4fa3-b216-19d83df0c565 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:44.677307 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-40df6188-2554-4fa3-b216-19d83df0c565 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:44.685128 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-40df6188-2554-4fa3-b216-19d83df0c565 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1314 microversion: 2.1 time: 0.148626 Sep 21 12:23:44.685703 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 195/388] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:44 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:45.320094 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-c740b22a-cf79-40c6-9afc-34cf73b31dcc tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:45.321075 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-c740b22a-cf79-40c6-9afc-34cf73b31dcc tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:45.327832 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c740b22a-cf79-40c6-9afc-34cf73b31dcc tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:45.328416 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c740b22a-cf79-40c6-9afc-34cf73b31dcc tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:45.328930 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c740b22a-cf79-40c6-9afc-34cf73b31dcc tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:45.329738 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c740b22a-cf79-40c6-9afc-34cf73b31dcc tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:45.330533 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c740b22a-cf79-40c6-9afc-34cf73b31dcc tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:45.331037 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c740b22a-cf79-40c6-9afc-34cf73b31dcc tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:45.464253 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-c740b22a-cf79-40c6-9afc-34cf73b31dcc tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:45.474276 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-c740b22a-cf79-40c6-9afc-34cf73b31dcc tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1322 microversion: 2.1 time: 0.158069 Sep 21 12:23:45.474841 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 194/389] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:45 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:45.551227 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-447fdf34-2a23-4914-b398-3becd644f313 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:45.552107 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-447fdf34-2a23-4914-b398-3becd644f313 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:45.558834 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-447fdf34-2a23-4914-b398-3becd644f313 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:45.559321 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-447fdf34-2a23-4914-b398-3becd644f313 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:45.559780 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-447fdf34-2a23-4914-b398-3becd644f313 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:45.560475 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-447fdf34-2a23-4914-b398-3becd644f313 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:45.561006 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-447fdf34-2a23-4914-b398-3becd644f313 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:45.561450 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-447fdf34-2a23-4914-b398-3becd644f313 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:45.594320 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-447fdf34-2a23-4914-b398-3becd644f313 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:45.594747 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-447fdf34-2a23-4914-b398-3becd644f313 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:45.595185 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-447fdf34-2a23-4914-b398-3becd644f313 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:45.595635 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.objects.instance [None req-447fdf34-2a23-4914-b398-3becd644f313 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lazy-loading 'fault' on Instance uuid 309d01e5-d152-40c7-bbe0-db2292d5f103 {{(pid=120463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 12:23:45.634773 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-447fdf34-2a23-4914-b398-3becd644f313 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f8e995175ec4c6583e1ad0c7fb902ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46922ef081642f6a3d8ad5d02e4155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:45.642815 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-447fdf34-2a23-4914-b398-3becd644f313 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 200 len: 1304 microversion: 2.1 time: 0.095458 Sep 21 12:23:45.643387 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 196/390] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:45 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:45.709003 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-d1f41541-5e58-47b8-81dd-5a7dc7df12bf tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:45.709747 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-d1f41541-5e58-47b8-81dd-5a7dc7df12bf tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:45.715660 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d1f41541-5e58-47b8-81dd-5a7dc7df12bf tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:45.716172 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d1f41541-5e58-47b8-81dd-5a7dc7df12bf tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:45.716612 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d1f41541-5e58-47b8-81dd-5a7dc7df12bf tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:45.717395 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d1f41541-5e58-47b8-81dd-5a7dc7df12bf tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:45.717844 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d1f41541-5e58-47b8-81dd-5a7dc7df12bf tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:45.718263 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d1f41541-5e58-47b8-81dd-5a7dc7df12bf tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:46.065912 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-d1f41541-5e58-47b8-81dd-5a7dc7df12bf tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:46.073586 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-d1f41541-5e58-47b8-81dd-5a7dc7df12bf tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1314 microversion: 2.1 time: 0.368597 Sep 21 12:23:46.074202 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 195/391] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:45 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:46.498484 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-e61a2205-9397-47ee-a734-bdb70285100e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:46.498751 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-e61a2205-9397-47ee-a734-bdb70285100e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:46.505463 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e61a2205-9397-47ee-a734-bdb70285100e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:46.506306 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e61a2205-9397-47ee-a734-bdb70285100e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:46.506877 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e61a2205-9397-47ee-a734-bdb70285100e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:46.508055 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e61a2205-9397-47ee-a734-bdb70285100e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:46.508696 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e61a2205-9397-47ee-a734-bdb70285100e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:46.509328 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e61a2205-9397-47ee-a734-bdb70285100e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:46.647928 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-e61a2205-9397-47ee-a734-bdb70285100e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:46.656743 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-e61a2205-9397-47ee-a734-bdb70285100e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1517 microversion: 2.1 time: 0.162440 Sep 21 12:23:46.657331 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 197/392] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:46 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:46.665123 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-37a6bdd9-0dbf-4f1f-9b79-2fe5d29eb2b1 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:46.665744 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-37a6bdd9-0dbf-4f1f-9b79-2fe5d29eb2b1 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] [instance: 309d01e5-d152-40c7-bbe0-db2292d5f103] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:46.671811 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-37a6bdd9-0dbf-4f1f-9b79-2fe5d29eb2b1 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:46.672284 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-37a6bdd9-0dbf-4f1f-9b79-2fe5d29eb2b1 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:46.672719 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-37a6bdd9-0dbf-4f1f-9b79-2fe5d29eb2b1 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:46.673412 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-37a6bdd9-0dbf-4f1f-9b79-2fe5d29eb2b1 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:46.673861 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-37a6bdd9-0dbf-4f1f-9b79-2fe5d29eb2b1 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:46.674285 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-37a6bdd9-0dbf-4f1f-9b79-2fe5d29eb2b1 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:46.678995 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-10af1dcf-122b-4af6-b88c-8368dad8c6f4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:23:46.681358 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-10af1dcf-122b-4af6-b88c-8368dad8c6f4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:46.688233 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-10af1dcf-122b-4af6-b88c-8368dad8c6f4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:46.688726 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-10af1dcf-122b-4af6-b88c-8368dad8c6f4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:46.689173 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-10af1dcf-122b-4af6-b88c-8368dad8c6f4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:46.689894 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-10af1dcf-122b-4af6-b88c-8368dad8c6f4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:46.690352 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-10af1dcf-122b-4af6-b88c-8368dad8c6f4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:46.690784 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-10af1dcf-122b-4af6-b88c-8368dad8c6f4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:46.691017 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.wsgi [None req-37a6bdd9-0dbf-4f1f-9b79-2fe5d29eb2b1 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] HTTP exception thrown: Instance 309d01e5-d152-40c7-bbe0-db2292d5f103 could not be found. Sep 21 12:23:46.692915 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-37a6bdd9-0dbf-4f1f-9b79-2fe5d29eb2b1 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Request method failure captured: Sep 21 12:23:46.692915 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: request: GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 HTTP/1.1 Sep 21 12:23:46.692915 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept: application/json Sep 21 12:23:46.692915 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept-Encoding: identity Sep 21 12:23:46.692915 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Connection: close Sep 21 12:23:46.692915 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Length: 0 Sep 21 12:23:46.692915 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Type: application/json Sep 21 12:23:46.692915 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Host: 10.222.0.71 Sep 21 12:23:46.692915 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Openstack-System-Scope: None Sep 21 12:23:46.692915 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: User-Agent: python-urllib3/1.26.12 Sep 21 12:23:46.692915 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Auth-Token: gAAAAABjKwH9twppulmCtTbtMjmE7h3nqj6bqBJj8Y5n4fLoSE0KEcgVI3YUK35-qfnWKNT5trWcVzUVffSwaSK8m_W9LUVNx104bz9GvQNefehbH-6TRkAEp93hv2v-8Uaf_F61wZgJhZkghZo9thJw1SYSGdyp1qWFkHgoUkxUtBHK7YWW2xo Sep 21 12:23:46.692915 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Id: None Sep 21 12:23:46.692915 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Name: None Sep 21 12:23:46.692915 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Identity-Status: Confirmed Sep 21 12:23:46.692915 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Is-Admin-Project: True Sep 21 12:23:46.692915 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Id: default Sep 21 12:23:46.692915 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Name: Default Sep 21 12:23:46.692915 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Id: c46922ef081642f6a3d8ad5d02e4155a Sep 21 12:23:46.692915 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Name: tempest-VolumesActionsTest-1210229347 Sep 21 12:23:46.692915 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Role: reader,member Sep 21 12:23:46.692915 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Roles: reader,member Sep 21 12:23:46.694260 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c46922ef081642f6a3d8ad5d02e4155a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c46922ef081642f6a3d8ad5d02e4155a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_c46922ef081642f6a3d8ad5d02e4155a", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/c46922ef081642f6a3d8ad5d02e4155a"}]}] Sep 21 12:23:46.694260 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant: tempest-VolumesActionsTest-1210229347 Sep 21 12:23:46.694260 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Id: c46922ef081642f6a3d8ad5d02e4155a Sep 21 12:23:46.694260 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Name: tempest-VolumesActionsTest-1210229347 Sep 21 12:23:46.694260 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User: tempest-VolumesActionsTest-1210229347-project Sep 21 12:23:46.694260 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Id: default Sep 21 12:23:46.694260 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Name: Default Sep 21 12:23:46.694260 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Id: 1f8e995175ec4c6583e1ad0c7fb902ab Sep 21 12:23:46.694260 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Name: tempest-VolumesActionsTest-1210229347-project Sep 21 12:23:46.694260 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: method: > Sep 21 12:23:46.694260 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: exception: Instance 309d01e5-d152-40c7-bbe0-db2292d5f103 could not be found. Sep 21 12:23:46.694260 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: action_args: {'id': '309d01e5-d152-40c7-bbe0-db2292d5f103'} Sep 21 12:23:46.695099 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:23:46.695099 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:23:46.695099 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:23:46.695099 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:23:46.695099 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:23:46.695099 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:23:46.695099 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:23:46.695099 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:23:46.695099 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:23:46.695099 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:23:46.695099 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 309d01e5-d152-40c7-bbe0-db2292d5f103 could not be found. Sep 21 12:23:46.695099 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:23:46.695099 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:23:46.695099 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:23:46.695099 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:23:46.695099 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:23:46.695099 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:23:46.695099 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:23:46.695099 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:23:46.695099 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:23:46.696361 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:23:46.696361 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 12:23:46.696361 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 12:23:46.696361 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:23:46.696361 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:23:46.696361 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:23:46.696361 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:23:46.696361 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 309d01e5-d152-40c7-bbe0-db2292d5f103 could not be found. Sep 21 12:23:46.696361 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:23:46.696361 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:23:46.696361 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:23:46.696361 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:23:46.696361 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:23:46.696361 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:23:46.696361 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:23:46.696361 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:23:46.696361 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 309d01e5-d152-40c7-bbe0-db2292d5f103 could not be found. Sep 21 12:23:46.696361 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:23:46.699738 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-37a6bdd9-0dbf-4f1f-9b79-2fe5d29eb2b1 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] Returning 404 to user: Instance 309d01e5-d152-40c7-bbe0-db2292d5f103 could not be found. {{(pid=120462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:23:46.699738 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-37a6bdd9-0dbf-4f1f-9b79-2fe5d29eb2b1 tempest-VolumesActionsTest-1210229347 tempest-VolumesActionsTest-1210229347-project] 10.222.0.71 "GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103" status: 404 len: 111 microversion: 2.1 time: 0.033300 Sep 21 12:23:46.699738 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 196/393] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:46 2022] GET /compute/v2.1/servers/309d01e5-d152-40c7-bbe0-db2292d5f103 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:23:46.717377 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.objects.instance [None req-10af1dcf-122b-4af6-b88c-8368dad8c6f4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lazy-loading 'flavor' on Instance uuid de0f1a98-9419-4e35-b8e0-520c7fc482fb {{(pid=120463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 12:23:46.890735 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-10af1dcf-122b-4af6-b88c-8368dad8c6f4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "POST /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb/action" status: 200 len: 32 microversion: 2.1 time: 0.214835 Sep 21 12:23:46.891788 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 198/394] 10.222.0.71 () {60 vars in 1278 bytes} [Wed Sep 21 12:23:46 2022] POST /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb/action => generated 32 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 21 12:23:46.905604 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-01d418ff-1f67-47c1-95d0-bb02f273b4f9 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:46.906296 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-01d418ff-1f67-47c1-95d0-bb02f273b4f9 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:46.912988 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-01d418ff-1f67-47c1-95d0-bb02f273b4f9 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:46.913474 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-01d418ff-1f67-47c1-95d0-bb02f273b4f9 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:46.913911 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-01d418ff-1f67-47c1-95d0-bb02f273b4f9 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:46.914662 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-01d418ff-1f67-47c1-95d0-bb02f273b4f9 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:46.915080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-01d418ff-1f67-47c1-95d0-bb02f273b4f9 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:46.916231 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-01d418ff-1f67-47c1-95d0-bb02f273b4f9 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:46.923037 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=100 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:47.101045 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-3c47af48-49dc-4e31-b7af-59bb59e12646 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:47.101752 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-3c47af48-49dc-4e31-b7af-59bb59e12646 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:47.109704 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3c47af48-49dc-4e31-b7af-59bb59e12646 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:47.110132 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3c47af48-49dc-4e31-b7af-59bb59e12646 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:47.110543 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3c47af48-49dc-4e31-b7af-59bb59e12646 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:47.111258 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3c47af48-49dc-4e31-b7af-59bb59e12646 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:47.111920 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3c47af48-49dc-4e31-b7af-59bb59e12646 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:47.112503 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3c47af48-49dc-4e31-b7af-59bb59e12646 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:47.266886 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-01d418ff-1f67-47c1-95d0-bb02f273b4f9 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:47.276953 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-01d418ff-1f67-47c1-95d0-bb02f273b4f9 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1523 microversion: 2.1 time: 0.375128 Sep 21 12:23:47.289408 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 197/395] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:46 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1523 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:47.289773 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-3c47af48-49dc-4e31-b7af-59bb59e12646 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:47.297791 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-3c47af48-49dc-4e31-b7af-59bb59e12646 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1314 microversion: 2.1 time: 0.200836 Sep 21 12:23:47.298498 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 199/396] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:47 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:48.299983 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-20f6f293-1818-4b62-af3f-59a1e01a66d8 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:48.300503 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-20f6f293-1818-4b62-af3f-59a1e01a66d8 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:48.306555 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-20f6f293-1818-4b62-af3f-59a1e01a66d8 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:48.307045 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-20f6f293-1818-4b62-af3f-59a1e01a66d8 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:48.307486 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-20f6f293-1818-4b62-af3f-59a1e01a66d8 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:48.308217 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-20f6f293-1818-4b62-af3f-59a1e01a66d8 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:48.308892 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-20f6f293-1818-4b62-af3f-59a1e01a66d8 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:48.309333 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-20f6f293-1818-4b62-af3f-59a1e01a66d8 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:48.320066 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-b0e8b839-297d-498d-a60c-5903c889969d tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:48.320678 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-b0e8b839-297d-498d-a60c-5903c889969d tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:48.327245 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b0e8b839-297d-498d-a60c-5903c889969d tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:48.327725 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b0e8b839-297d-498d-a60c-5903c889969d tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:48.328183 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b0e8b839-297d-498d-a60c-5903c889969d tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:48.328880 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b0e8b839-297d-498d-a60c-5903c889969d tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:48.329327 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b0e8b839-297d-498d-a60c-5903c889969d tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:48.329751 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b0e8b839-297d-498d-a60c-5903c889969d tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:48.452821 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-20f6f293-1818-4b62-af3f-59a1e01a66d8 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:48.461216 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-20f6f293-1818-4b62-af3f-59a1e01a66d8 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1523 microversion: 2.1 time: 0.165236 Sep 21 12:23:48.461801 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 198/397] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:48 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:48.479950 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-b0e8b839-297d-498d-a60c-5903c889969d tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:48.488433 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-b0e8b839-297d-498d-a60c-5903c889969d tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1314 microversion: 2.1 time: 0.172229 Sep 21 12:23:48.489004 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 200/398] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:48 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:23:49.484713 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-99e37d2b-309b-49c4-a232-b94298474334 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:49.485329 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-99e37d2b-309b-49c4-a232-b94298474334 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:49.494873 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-99e37d2b-309b-49c4-a232-b94298474334 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:49.495364 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-99e37d2b-309b-49c4-a232-b94298474334 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:49.495836 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-99e37d2b-309b-49c4-a232-b94298474334 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:49.496541 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-99e37d2b-309b-49c4-a232-b94298474334 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:49.497006 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-99e37d2b-309b-49c4-a232-b94298474334 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:49.497434 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-99e37d2b-309b-49c4-a232-b94298474334 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:49.512418 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-a4d08cbd-0192-481a-bac0-11e2fe926809 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:49.513066 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-a4d08cbd-0192-481a-bac0-11e2fe926809 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:49.520586 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a4d08cbd-0192-481a-bac0-11e2fe926809 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:49.521070 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a4d08cbd-0192-481a-bac0-11e2fe926809 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:49.521521 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a4d08cbd-0192-481a-bac0-11e2fe926809 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:49.522211 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a4d08cbd-0192-481a-bac0-11e2fe926809 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:49.522659 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a4d08cbd-0192-481a-bac0-11e2fe926809 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:49.523080 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a4d08cbd-0192-481a-bac0-11e2fe926809 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:49.634261 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-99e37d2b-309b-49c4-a232-b94298474334 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:49.642743 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-99e37d2b-309b-49c4-a232-b94298474334 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1523 microversion: 2.1 time: 0.161947 Sep 21 12:23:49.643506 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 199/399] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:49 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:49.663090 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a4d08cbd-0192-481a-bac0-11e2fe926809 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:49.670707 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-a4d08cbd-0192-481a-bac0-11e2fe926809 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1314 microversion: 2.1 time: 0.162534 Sep 21 12:23:49.671277 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 201/400] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:49 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:23:50.665826 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-b3ae42a4-af05-4dce-9d04-5c887bb5d4b5 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:50.666444 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-b3ae42a4-af05-4dce-9d04-5c887bb5d4b5 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:50.672480 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b3ae42a4-af05-4dce-9d04-5c887bb5d4b5 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:50.672972 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b3ae42a4-af05-4dce-9d04-5c887bb5d4b5 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:50.673415 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b3ae42a4-af05-4dce-9d04-5c887bb5d4b5 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:50.674111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b3ae42a4-af05-4dce-9d04-5c887bb5d4b5 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:50.674567 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b3ae42a4-af05-4dce-9d04-5c887bb5d4b5 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:50.675055 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b3ae42a4-af05-4dce-9d04-5c887bb5d4b5 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:50.693163 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-ca9d8365-164d-43b9-9449-a8d6243d5f5c tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:50.693777 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-ca9d8365-164d-43b9-9449-a8d6243d5f5c tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:50.700270 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ca9d8365-164d-43b9-9449-a8d6243d5f5c tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:50.700758 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ca9d8365-164d-43b9-9449-a8d6243d5f5c tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:50.701683 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ca9d8365-164d-43b9-9449-a8d6243d5f5c tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:50.702372 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ca9d8365-164d-43b9-9449-a8d6243d5f5c tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:50.702828 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ca9d8365-164d-43b9-9449-a8d6243d5f5c tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:50.703254 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ca9d8365-164d-43b9-9449-a8d6243d5f5c tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:50.807796 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-b3ae42a4-af05-4dce-9d04-5c887bb5d4b5 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:50.815797 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-b3ae42a4-af05-4dce-9d04-5c887bb5d4b5 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1523 microversion: 2.1 time: 0.153841 Sep 21 12:23:50.816357 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 200/401] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:50 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:23:50.834456 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-ca9d8365-164d-43b9-9449-a8d6243d5f5c tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:50.843409 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-ca9d8365-164d-43b9-9449-a8d6243d5f5c tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1314 microversion: 2.1 time: 0.154034 Sep 21 12:23:50.844019 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 202/402] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:50 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:23:51.839514 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-a4b7be2c-afdf-4568-b6e0-1a7bc62b8544 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:51.840166 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-a4b7be2c-afdf-4568-b6e0-1a7bc62b8544 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:51.846785 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a4b7be2c-afdf-4568-b6e0-1a7bc62b8544 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:51.847272 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a4b7be2c-afdf-4568-b6e0-1a7bc62b8544 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:51.847714 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a4b7be2c-afdf-4568-b6e0-1a7bc62b8544 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:51.848439 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a4b7be2c-afdf-4568-b6e0-1a7bc62b8544 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:51.848899 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a4b7be2c-afdf-4568-b6e0-1a7bc62b8544 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:51.849333 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a4b7be2c-afdf-4568-b6e0-1a7bc62b8544 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:51.866382 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-d05736de-f35a-490b-af06-c8dc0a25d385 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:51.866996 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-d05736de-f35a-490b-af06-c8dc0a25d385 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:51.873683 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d05736de-f35a-490b-af06-c8dc0a25d385 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:51.874187 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d05736de-f35a-490b-af06-c8dc0a25d385 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:51.874638 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d05736de-f35a-490b-af06-c8dc0a25d385 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:51.875354 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d05736de-f35a-490b-af06-c8dc0a25d385 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:51.875833 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d05736de-f35a-490b-af06-c8dc0a25d385 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:51.876275 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d05736de-f35a-490b-af06-c8dc0a25d385 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:51.981252 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-a4b7be2c-afdf-4568-b6e0-1a7bc62b8544 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:51.990065 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-a4b7be2c-afdf-4568-b6e0-1a7bc62b8544 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1523 microversion: 2.1 time: 0.154573 Sep 21 12:23:51.990870 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 201/403] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:51 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:52.010095 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-d05736de-f35a-490b-af06-c8dc0a25d385 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:52.017722 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-d05736de-f35a-490b-af06-c8dc0a25d385 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1314 microversion: 2.1 time: 0.155117 Sep 21 12:23:52.018234 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 203/404] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:51 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:23:53.013146 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-60e9f3a0-d048-4e1d-be6a-218d562295a0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:53.013821 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-60e9f3a0-d048-4e1d-be6a-218d562295a0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:53.019894 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-60e9f3a0-d048-4e1d-be6a-218d562295a0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:53.020331 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-60e9f3a0-d048-4e1d-be6a-218d562295a0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:53.020773 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-60e9f3a0-d048-4e1d-be6a-218d562295a0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:53.021471 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-60e9f3a0-d048-4e1d-be6a-218d562295a0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:53.021937 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-60e9f3a0-d048-4e1d-be6a-218d562295a0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:53.022368 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-60e9f3a0-d048-4e1d-be6a-218d562295a0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:53.040830 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-1a3df208-73b2-451b-937b-74f4b80aa3f4 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:53.041452 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-1a3df208-73b2-451b-937b-74f4b80aa3f4 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:53.043903 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=86 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:53.050915 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1a3df208-73b2-451b-937b-74f4b80aa3f4 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:53.051522 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1a3df208-73b2-451b-937b-74f4b80aa3f4 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:53.052116 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1a3df208-73b2-451b-937b-74f4b80aa3f4 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:53.052993 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1a3df208-73b2-451b-937b-74f4b80aa3f4 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:53.053821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1a3df208-73b2-451b-937b-74f4b80aa3f4 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:53.054582 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1a3df208-73b2-451b-937b-74f4b80aa3f4 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:53.080651 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:53.160714 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-60e9f3a0-d048-4e1d-be6a-218d562295a0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:53.168606 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-60e9f3a0-d048-4e1d-be6a-218d562295a0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1523 microversion: 2.1 time: 0.159352 Sep 21 12:23:53.169187 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 202/405] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:53 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:53.200610 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-1a3df208-73b2-451b-937b-74f4b80aa3f4 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:53.208448 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-1a3df208-73b2-451b-937b-74f4b80aa3f4 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1314 microversion: 2.1 time: 0.171697 Sep 21 12:23:53.209026 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 204/406] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:53 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:23:54.193560 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-e1204090-a507-4062-879b-358be85d0fd2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:54.194504 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-e1204090-a507-4062-879b-358be85d0fd2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:54.208024 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e1204090-a507-4062-879b-358be85d0fd2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:54.209142 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e1204090-a507-4062-879b-358be85d0fd2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:54.209809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e1204090-a507-4062-879b-358be85d0fd2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:54.210872 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e1204090-a507-4062-879b-358be85d0fd2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:54.212401 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e1204090-a507-4062-879b-358be85d0fd2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:54.213338 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e1204090-a507-4062-879b-358be85d0fd2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:54.236170 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-b71d767c-417f-4d23-8cdd-015f60fccace tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:54.237799 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-b71d767c-417f-4d23-8cdd-015f60fccace tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:54.248293 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b71d767c-417f-4d23-8cdd-015f60fccace tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:54.249167 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b71d767c-417f-4d23-8cdd-015f60fccace tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:54.249777 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b71d767c-417f-4d23-8cdd-015f60fccace tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:54.250790 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b71d767c-417f-4d23-8cdd-015f60fccace tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:54.251402 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b71d767c-417f-4d23-8cdd-015f60fccace tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:54.252021 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b71d767c-417f-4d23-8cdd-015f60fccace tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:54.471739 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-b71d767c-417f-4d23-8cdd-015f60fccace tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:54.484394 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-b71d767c-417f-4d23-8cdd-015f60fccace tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1314 microversion: 2.1 time: 0.255040 Sep 21 12:23:54.506630 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 205/407] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:54 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:54.520682 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-e1204090-a507-4062-879b-358be85d0fd2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:54.531418 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-e1204090-a507-4062-879b-358be85d0fd2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1523 microversion: 2.1 time: 0.342708 Sep 21 12:23:54.535809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 203/408] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:54 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1523 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:55.510178 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-1ffeaaff-a77f-44e8-9b39-8a8c2d84210e tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:55.511495 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-1ffeaaff-a77f-44e8-9b39-8a8c2d84210e tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:55.520819 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1ffeaaff-a77f-44e8-9b39-8a8c2d84210e tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:55.521563 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1ffeaaff-a77f-44e8-9b39-8a8c2d84210e tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:55.522168 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1ffeaaff-a77f-44e8-9b39-8a8c2d84210e tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:55.523070 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1ffeaaff-a77f-44e8-9b39-8a8c2d84210e tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:55.523783 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1ffeaaff-a77f-44e8-9b39-8a8c2d84210e tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:55.524550 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1ffeaaff-a77f-44e8-9b39-8a8c2d84210e tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:55.557272 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-2430b081-8464-4bfa-a650-f9597157fa83 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:55.558387 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-2430b081-8464-4bfa-a650-f9597157fa83 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:55.565847 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_api:SELECT=80 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:55.569478 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2430b081-8464-4bfa-a650-f9597157fa83 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:55.570325 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2430b081-8464-4bfa-a650-f9597157fa83 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:55.570999 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2430b081-8464-4bfa-a650-f9597157fa83 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:55.572264 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2430b081-8464-4bfa-a650-f9597157fa83 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:55.573000 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2430b081-8464-4bfa-a650-f9597157fa83 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:55.573699 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2430b081-8464-4bfa-a650-f9597157fa83 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:55.751868 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-1ffeaaff-a77f-44e8-9b39-8a8c2d84210e tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:55.772825 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-1ffeaaff-a77f-44e8-9b39-8a8c2d84210e tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1314 microversion: 2.1 time: 0.266500 Sep 21 12:23:55.788817 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 206/409] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:55 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:55.920956 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-2430b081-8464-4bfa-a650-f9597157fa83 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:55.936505 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-2430b081-8464-4bfa-a650-f9597157fa83 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1523 microversion: 2.1 time: 0.383843 Sep 21 12:23:55.938585 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 204/410] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:55 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1523 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:23:56.801327 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-2b5ef410-9fd7-441b-89ed-e8ad60a2f145 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:56.802060 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-2b5ef410-9fd7-441b-89ed-e8ad60a2f145 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:56.813023 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2b5ef410-9fd7-441b-89ed-e8ad60a2f145 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:56.824569 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2b5ef410-9fd7-441b-89ed-e8ad60a2f145 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:56.825305 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2b5ef410-9fd7-441b-89ed-e8ad60a2f145 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:56.826258 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2b5ef410-9fd7-441b-89ed-e8ad60a2f145 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:56.826883 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2b5ef410-9fd7-441b-89ed-e8ad60a2f145 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:56.827318 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2b5ef410-9fd7-441b-89ed-e8ad60a2f145 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:56.964404 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-41a6cfed-8cfd-49bf-adb1-a59acb08067d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:56.965037 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-41a6cfed-8cfd-49bf-adb1-a59acb08067d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:56.974627 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-41a6cfed-8cfd-49bf-adb1-a59acb08067d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:56.975123 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-41a6cfed-8cfd-49bf-adb1-a59acb08067d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:56.975569 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-41a6cfed-8cfd-49bf-adb1-a59acb08067d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:56.976312 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-41a6cfed-8cfd-49bf-adb1-a59acb08067d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:56.976771 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-41a6cfed-8cfd-49bf-adb1-a59acb08067d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:56.977200 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-41a6cfed-8cfd-49bf-adb1-a59acb08067d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:56.989623 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-2b5ef410-9fd7-441b-89ed-e8ad60a2f145 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:56.998594 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-2b5ef410-9fd7-441b-89ed-e8ad60a2f145 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1314 microversion: 2.1 time: 0.202021 Sep 21 12:23:56.999192 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 207/411] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:56 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:57.196376 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-41a6cfed-8cfd-49bf-adb1-a59acb08067d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:57.209452 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-41a6cfed-8cfd-49bf-adb1-a59acb08067d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1523 microversion: 2.1 time: 0.248882 Sep 21 12:23:57.211146 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 205/412] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:56 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1523 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:23:58.032765 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-8eb225f1-1a16-4601-a10a-c0b64f0720cf tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:58.036501 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-8eb225f1-1a16-4601-a10a-c0b64f0720cf tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:58.056432 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8eb225f1-1a16-4601-a10a-c0b64f0720cf tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:58.061398 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8eb225f1-1a16-4601-a10a-c0b64f0720cf tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:58.063342 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8eb225f1-1a16-4601-a10a-c0b64f0720cf tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:58.064404 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8eb225f1-1a16-4601-a10a-c0b64f0720cf tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:58.066154 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8eb225f1-1a16-4601-a10a-c0b64f0720cf tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:58.066828 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8eb225f1-1a16-4601-a10a-c0b64f0720cf tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:58.237653 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-b9026ea9-dd0f-424c-b9e3-f8bf77015cfd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:58.239048 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-b9026ea9-dd0f-424c-b9e3-f8bf77015cfd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:58.255334 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b9026ea9-dd0f-424c-b9e3-f8bf77015cfd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:58.256571 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b9026ea9-dd0f-424c-b9e3-f8bf77015cfd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:58.257325 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b9026ea9-dd0f-424c-b9e3-f8bf77015cfd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:58.258380 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b9026ea9-dd0f-424c-b9e3-f8bf77015cfd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:58.260810 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b9026ea9-dd0f-424c-b9e3-f8bf77015cfd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:58.261619 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b9026ea9-dd0f-424c-b9e3-f8bf77015cfd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:58.342913 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-8eb225f1-1a16-4601-a10a-c0b64f0720cf tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:58.353126 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-8eb225f1-1a16-4601-a10a-c0b64f0720cf tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1314 microversion: 2.1 time: 0.330423 Sep 21 12:23:58.355664 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 208/413] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:58 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:58.387126 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-4bb6d5af-ed3d-4a4d-b540-0c9afc25873d req-17476ada-f51a-45e0-919a-50d55b23704d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "714df43c-52c2-426d-a391-bf58f3fa2584", "name": "network-vif-plugged", "status": "completed", "tag": "77262639-075d-4f0b-8e2b-dee03a44e539"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:23:58.397393 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-4bb6d5af-ed3d-4a4d-b540-0c9afc25873d req-17476ada-f51a-45e0-919a-50d55b23704d service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:58.398025 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-4bb6d5af-ed3d-4a4d-b540-0c9afc25873d req-17476ada-f51a-45e0-919a-50d55b23704d service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:58.398603 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-4bb6d5af-ed3d-4a4d-b540-0c9afc25873d req-17476ada-f51a-45e0-919a-50d55b23704d service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:58.410476 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-4bb6d5af-ed3d-4a4d-b540-0c9afc25873d req-17476ada-f51a-45e0-919a-50d55b23704d service nova] Creating event network-vif-plugged:77262639-075d-4f0b-8e2b-dee03a44e539 for instance 714df43c-52c2-426d-a391-bf58f3fa2584 on hv-cinder-85867 Sep 21 12:23:58.421546 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-4bb6d5af-ed3d-4a4d-b540-0c9afc25873d req-17476ada-f51a-45e0-919a-50d55b23704d service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035971 Sep 21 12:23:58.422576 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 209/414] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 12:23:58.510868 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-b9026ea9-dd0f-424c-b9e3-f8bf77015cfd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:58.521104 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-b9026ea9-dd0f-424c-b9e3-f8bf77015cfd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1523 microversion: 2.1 time: 0.288799 Sep 21 12:23:58.538569 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 206/415] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:58 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1523 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:59.385965 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-72af2544-3ccd-42ca-8d7f-cd353cc3e39f tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:59.404230 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-72af2544-3ccd-42ca-8d7f-cd353cc3e39f tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:59.415259 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-72af2544-3ccd-42ca-8d7f-cd353cc3e39f tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:59.416061 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-72af2544-3ccd-42ca-8d7f-cd353cc3e39f tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:59.416343 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-72af2544-3ccd-42ca-8d7f-cd353cc3e39f tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:59.421354 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-72af2544-3ccd-42ca-8d7f-cd353cc3e39f tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:59.422390 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-72af2544-3ccd-42ca-8d7f-cd353cc3e39f tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:59.423231 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-72af2544-3ccd-42ca-8d7f-cd353cc3e39f tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:59.547257 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-0989bc46-04e6-4c33-a05d-bcef8b6b6111 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:23:59.547952 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-0989bc46-04e6-4c33-a05d-bcef8b6b6111 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:23:59.554262 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0989bc46-04e6-4c33-a05d-bcef8b6b6111 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:59.554759 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0989bc46-04e6-4c33-a05d-bcef8b6b6111 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:59.555197 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0989bc46-04e6-4c33-a05d-bcef8b6b6111 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:59.555936 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0989bc46-04e6-4c33-a05d-bcef8b6b6111 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:23:59.556396 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0989bc46-04e6-4c33-a05d-bcef8b6b6111 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:23:59.556824 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0989bc46-04e6-4c33-a05d-bcef8b6b6111 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:23:59.590252 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-72af2544-3ccd-42ca-8d7f-cd353cc3e39f tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:59.600226 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-72af2544-3ccd-42ca-8d7f-cd353cc3e39f tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1314 microversion: 2.1 time: 0.225019 Sep 21 12:23:59.601120 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 210/416] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:59 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:23:59.707647 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-0989bc46-04e6-4c33-a05d-bcef8b6b6111 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:23:59.716458 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-0989bc46-04e6-4c33-a05d-bcef8b6b6111 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1523 microversion: 2.1 time: 0.173573 Sep 21 12:23:59.717470 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 207/417] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:23:59 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:00.625732 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-caa9ffa2-7e9a-4462-9136-3f8b3d86b9bd tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:00.627067 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-caa9ffa2-7e9a-4462-9136-3f8b3d86b9bd tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:00.640714 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-caa9ffa2-7e9a-4462-9136-3f8b3d86b9bd tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:00.642612 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-caa9ffa2-7e9a-4462-9136-3f8b3d86b9bd tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:00.645172 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-caa9ffa2-7e9a-4462-9136-3f8b3d86b9bd tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:00.647603 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-caa9ffa2-7e9a-4462-9136-3f8b3d86b9bd tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:00.648569 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-caa9ffa2-7e9a-4462-9136-3f8b3d86b9bd tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:00.649068 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-caa9ffa2-7e9a-4462-9136-3f8b3d86b9bd tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:00.740783 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-4ce6f634-fc3d-41b1-9503-d278007f8ad7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:00.746710 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-4ce6f634-fc3d-41b1-9503-d278007f8ad7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:00.753268 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4ce6f634-fc3d-41b1-9503-d278007f8ad7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:00.753748 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4ce6f634-fc3d-41b1-9503-d278007f8ad7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:00.754180 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4ce6f634-fc3d-41b1-9503-d278007f8ad7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:00.754880 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4ce6f634-fc3d-41b1-9503-d278007f8ad7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:00.755332 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4ce6f634-fc3d-41b1-9503-d278007f8ad7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:00.755781 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4ce6f634-fc3d-41b1-9503-d278007f8ad7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:00.810074 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-caa9ffa2-7e9a-4462-9136-3f8b3d86b9bd tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:00.818343 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-caa9ffa2-7e9a-4462-9136-3f8b3d86b9bd tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1314 microversion: 2.1 time: 0.197494 Sep 21 12:24:00.833802 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 211/418] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:00 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:00.911084 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-4ce6f634-fc3d-41b1-9503-d278007f8ad7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:00.920102 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-4ce6f634-fc3d-41b1-9503-d278007f8ad7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1523 microversion: 2.1 time: 0.182528 Sep 21 12:24:00.920970 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 208/419] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:00 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:24:01.842496 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-84fe9c94-2db6-4ce2-acaf-4bc9c1db33b7 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:01.843510 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-84fe9c94-2db6-4ce2-acaf-4bc9c1db33b7 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:01.855267 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-84fe9c94-2db6-4ce2-acaf-4bc9c1db33b7 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:01.855984 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-84fe9c94-2db6-4ce2-acaf-4bc9c1db33b7 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:01.856670 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-84fe9c94-2db6-4ce2-acaf-4bc9c1db33b7 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:01.857562 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-84fe9c94-2db6-4ce2-acaf-4bc9c1db33b7 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:01.858117 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-84fe9c94-2db6-4ce2-acaf-4bc9c1db33b7 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:01.858642 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-84fe9c94-2db6-4ce2-acaf-4bc9c1db33b7 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:01.946966 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-b59a5586-ef24-4657-b9a0-3e819f43b131 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:01.948190 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-b59a5586-ef24-4657-b9a0-3e819f43b131 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:01.956779 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b59a5586-ef24-4657-b9a0-3e819f43b131 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:01.957558 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b59a5586-ef24-4657-b9a0-3e819f43b131 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:01.958179 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b59a5586-ef24-4657-b9a0-3e819f43b131 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:01.959061 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b59a5586-ef24-4657-b9a0-3e819f43b131 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:01.959579 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b59a5586-ef24-4657-b9a0-3e819f43b131 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:01.960200 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b59a5586-ef24-4657-b9a0-3e819f43b131 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:02.054629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-84fe9c94-2db6-4ce2-acaf-4bc9c1db33b7 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:02.071254 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-84fe9c94-2db6-4ce2-acaf-4bc9c1db33b7 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1464 microversion: 2.1 time: 0.233052 Sep 21 12:24:02.073016 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 212/420] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:01 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1464 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:02.137763 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-f2a1526c-25c7-46c3-9a89-3d12063f1463 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:02.138333 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-f2a1526c-25c7-46c3-9a89-3d12063f1463 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:02.150630 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f2a1526c-25c7-46c3-9a89-3d12063f1463 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:02.151212 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f2a1526c-25c7-46c3-9a89-3d12063f1463 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:02.151990 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f2a1526c-25c7-46c3-9a89-3d12063f1463 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:02.154087 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f2a1526c-25c7-46c3-9a89-3d12063f1463 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:02.154699 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f2a1526c-25c7-46c3-9a89-3d12063f1463 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:02.155152 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f2a1526c-25c7-46c3-9a89-3d12063f1463 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:02.193248 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-f2a1526c-25c7-46c3-9a89-3d12063f1463 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Going to try to terminate instance {{(pid=120463) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 12:24:02.226160 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-b59a5586-ef24-4657-b9a0-3e819f43b131 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:02.242459 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-b59a5586-ef24-4657-b9a0-3e819f43b131 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1523 microversion: 2.1 time: 0.301121 Sep 21 12:24:02.247670 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 209/421] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:01 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1523 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:02.321101 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-f2a1526c-25c7-46c3-9a89-3d12063f1463 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "DELETE /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 204 len: 0 microversion: 2.1 time: 0.189462 Sep 21 12:24:02.321894 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 213/422] 10.222.0.71 () {58 vars in 1239 bytes} [Wed Sep 21 12:24:02 2022] DELETE /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 21 12:24:02.332770 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-6e9d6158-3bd2-4af5-ae9d-6dad2b1194f7 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:02.333647 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-6e9d6158-3bd2-4af5-ae9d-6dad2b1194f7 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:02.342118 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6e9d6158-3bd2-4af5-ae9d-6dad2b1194f7 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:02.342855 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6e9d6158-3bd2-4af5-ae9d-6dad2b1194f7 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:02.343368 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6e9d6158-3bd2-4af5-ae9d-6dad2b1194f7 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:02.344398 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6e9d6158-3bd2-4af5-ae9d-6dad2b1194f7 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:02.344933 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6e9d6158-3bd2-4af5-ae9d-6dad2b1194f7 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:02.345518 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6e9d6158-3bd2-4af5-ae9d-6dad2b1194f7 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:02.563475 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-6e9d6158-3bd2-4af5-ae9d-6dad2b1194f7 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:02.572621 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-6e9d6158-3bd2-4af5-ae9d-6dad2b1194f7 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1470 microversion: 2.1 time: 0.245895 Sep 21 12:24:02.573217 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 210/423] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:02 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1470 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:03.272050 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-ee79c36e-881d-4430-b1fc-223c3d70974a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:03.274620 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-ee79c36e-881d-4430-b1fc-223c3d70974a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:03.285906 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ee79c36e-881d-4430-b1fc-223c3d70974a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:03.286994 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ee79c36e-881d-4430-b1fc-223c3d70974a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:03.287542 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ee79c36e-881d-4430-b1fc-223c3d70974a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:03.288392 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ee79c36e-881d-4430-b1fc-223c3d70974a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:03.288930 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ee79c36e-881d-4430-b1fc-223c3d70974a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:03.289741 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ee79c36e-881d-4430-b1fc-223c3d70974a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:03.504313 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-ee79c36e-881d-4430-b1fc-223c3d70974a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:03.518150 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-ee79c36e-881d-4430-b1fc-223c3d70974a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1523 microversion: 2.1 time: 0.252649 Sep 21 12:24:03.519832 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 214/424] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:03 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1523 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:03.601150 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-11ab66f3-7a3b-4005-82f3-6574c1bf340b tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:03.601822 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-11ab66f3-7a3b-4005-82f3-6574c1bf340b tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:03.609046 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-11ab66f3-7a3b-4005-82f3-6574c1bf340b tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:03.609542 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-11ab66f3-7a3b-4005-82f3-6574c1bf340b tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:03.609985 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-11ab66f3-7a3b-4005-82f3-6574c1bf340b tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:03.610702 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-11ab66f3-7a3b-4005-82f3-6574c1bf340b tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:03.611222 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-11ab66f3-7a3b-4005-82f3-6574c1bf340b tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:03.611729 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-11ab66f3-7a3b-4005-82f3-6574c1bf340b tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:03.778426 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-11ab66f3-7a3b-4005-82f3-6574c1bf340b tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:03.790493 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-11ab66f3-7a3b-4005-82f3-6574c1bf340b tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1470 microversion: 2.1 time: 0.193188 Sep 21 12:24:03.791176 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 211/425] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:03 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1470 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:04.551105 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-6759f096-63b2-48a9-800e-72b104170ed3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:04.551719 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-6759f096-63b2-48a9-800e-72b104170ed3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:04.558480 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6759f096-63b2-48a9-800e-72b104170ed3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:04.559290 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6759f096-63b2-48a9-800e-72b104170ed3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:04.559773 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6759f096-63b2-48a9-800e-72b104170ed3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:04.560665 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6759f096-63b2-48a9-800e-72b104170ed3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:04.561271 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6759f096-63b2-48a9-800e-72b104170ed3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:04.561868 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6759f096-63b2-48a9-800e-72b104170ed3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:04.780071 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-6759f096-63b2-48a9-800e-72b104170ed3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:04.808430 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-6759f096-63b2-48a9-800e-72b104170ed3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1523 microversion: 2.1 time: 0.261066 Sep 21 12:24:04.816573 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-0d349c97-92e7-4e87-bfdb-be4a592084e8 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:04.818204 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-0d349c97-92e7-4e87-bfdb-be4a592084e8 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:04.824491 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 215/426] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:04 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1523 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:04.826458 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0d349c97-92e7-4e87-bfdb-be4a592084e8 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:04.827500 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0d349c97-92e7-4e87-bfdb-be4a592084e8 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:04.828229 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0d349c97-92e7-4e87-bfdb-be4a592084e8 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:04.829053 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0d349c97-92e7-4e87-bfdb-be4a592084e8 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:04.829941 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0d349c97-92e7-4e87-bfdb-be4a592084e8 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:04.830571 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0d349c97-92e7-4e87-bfdb-be4a592084e8 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:05.092008 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-0d349c97-92e7-4e87-bfdb-be4a592084e8 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:05.100045 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-0d349c97-92e7-4e87-bfdb-be4a592084e8 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1470 microversion: 2.1 time: 0.287235 Sep 21 12:24:05.104663 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 212/427] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:04 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1470 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:24:05.444485 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-7f9a60b4-ddba-44f1-a443-1fb05da75310 req-59e2735b-4b1a-4185-8e7b-0603600a3efa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "714df43c-52c2-426d-a391-bf58f3fa2584", "name": "network-vif-deleted", "tag": "77262639-075d-4f0b-8e2b-dee03a44e539"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:24:05.468662 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-7f9a60b4-ddba-44f1-a443-1fb05da75310 req-59e2735b-4b1a-4185-8e7b-0603600a3efa service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:05.470923 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-7f9a60b4-ddba-44f1-a443-1fb05da75310 req-59e2735b-4b1a-4185-8e7b-0603600a3efa service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:05.472804 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-7f9a60b4-ddba-44f1-a443-1fb05da75310 req-59e2735b-4b1a-4185-8e7b-0603600a3efa service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:05.496914 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-7f9a60b4-ddba-44f1-a443-1fb05da75310 req-59e2735b-4b1a-4185-8e7b-0603600a3efa service nova] Creating event network-vif-deleted:77262639-075d-4f0b-8e2b-dee03a44e539 for instance 714df43c-52c2-426d-a391-bf58f3fa2584 on hv-cinder-85867 Sep 21 12:24:05.506740 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-7f9a60b4-ddba-44f1-a443-1fb05da75310 req-59e2735b-4b1a-4185-8e7b-0603600a3efa service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065552 Sep 21 12:24:05.511533 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 216/428] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:24:05.845762 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-a2cf00dd-293b-46f3-a6f8-b3664ab9e6ac tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:05.847347 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-a2cf00dd-293b-46f3-a6f8-b3664ab9e6ac tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:05.853996 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a2cf00dd-293b-46f3-a6f8-b3664ab9e6ac tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:05.854845 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a2cf00dd-293b-46f3-a6f8-b3664ab9e6ac tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:05.855508 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a2cf00dd-293b-46f3-a6f8-b3664ab9e6ac tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:05.856430 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a2cf00dd-293b-46f3-a6f8-b3664ab9e6ac tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:05.857745 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a2cf00dd-293b-46f3-a6f8-b3664ab9e6ac tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:05.858333 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a2cf00dd-293b-46f3-a6f8-b3664ab9e6ac tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:06.078978 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-a2cf00dd-293b-46f3-a6f8-b3664ab9e6ac tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:06.081765 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=100 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:06.090252 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-a2cf00dd-293b-46f3-a6f8-b3664ab9e6ac tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1523 microversion: 2.1 time: 0.260674 Sep 21 12:24:06.091640 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 213/429] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:05 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1523 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:06.132191 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-a45d292b-0cad-41f7-bc04-3565ff827b52 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:06.133195 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-a45d292b-0cad-41f7-bc04-3565ff827b52 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:06.142979 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a45d292b-0cad-41f7-bc04-3565ff827b52 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:06.143628 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a45d292b-0cad-41f7-bc04-3565ff827b52 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:06.144446 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a45d292b-0cad-41f7-bc04-3565ff827b52 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:06.145305 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a45d292b-0cad-41f7-bc04-3565ff827b52 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:06.145931 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a45d292b-0cad-41f7-bc04-3565ff827b52 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:06.146526 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a45d292b-0cad-41f7-bc04-3565ff827b52 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:06.183388 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a45d292b-0cad-41f7-bc04-3565ff827b52 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:06.184331 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a45d292b-0cad-41f7-bc04-3565ff827b52 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:06.185047 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a45d292b-0cad-41f7-bc04-3565ff827b52 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:06.185755 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.objects.instance [None req-a45d292b-0cad-41f7-bc04-3565ff827b52 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lazy-loading 'fault' on Instance uuid 714df43c-52c2-426d-a391-bf58f3fa2584 {{(pid=120463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 12:24:06.233773 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a45d292b-0cad-41f7-bc04-3565ff827b52 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c80648c3936461295821ce1431a4164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a86f263882a44f385804b84f83d735c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:06.246638 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-a45d292b-0cad-41f7-bc04-3565ff827b52 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 200 len: 1304 microversion: 2.1 time: 0.119536 Sep 21 12:24:06.248733 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 217/430] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:06 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 1304 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:07.115067 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-69396027-b613-4ea8-96c8-19f0cdbb180c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:07.115519 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-69396027-b613-4ea8-96c8-19f0cdbb180c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:07.122932 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-69396027-b613-4ea8-96c8-19f0cdbb180c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:07.123428 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-69396027-b613-4ea8-96c8-19f0cdbb180c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:07.123907 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-69396027-b613-4ea8-96c8-19f0cdbb180c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:07.124591 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-69396027-b613-4ea8-96c8-19f0cdbb180c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:07.125223 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-69396027-b613-4ea8-96c8-19f0cdbb180c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:07.125993 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-69396027-b613-4ea8-96c8-19f0cdbb180c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:07.273844 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-52a71296-739e-410e-b92d-dca759fca346 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:07.276562 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-52a71296-739e-410e-b92d-dca759fca346 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] [instance: 714df43c-52c2-426d-a391-bf58f3fa2584] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:07.305789 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-52a71296-739e-410e-b92d-dca759fca346 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:07.306475 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-52a71296-739e-410e-b92d-dca759fca346 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:07.307216 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-52a71296-739e-410e-b92d-dca759fca346 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:07.308542 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-52a71296-739e-410e-b92d-dca759fca346 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:07.312591 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-52a71296-739e-410e-b92d-dca759fca346 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:07.313419 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-52a71296-739e-410e-b92d-dca759fca346 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:07.343518 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.wsgi [None req-52a71296-739e-410e-b92d-dca759fca346 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] HTTP exception thrown: Instance 714df43c-52c2-426d-a391-bf58f3fa2584 could not be found. Sep 21 12:24:07.346742 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-52a71296-739e-410e-b92d-dca759fca346 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Request method failure captured: Sep 21 12:24:07.346742 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: request: GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 HTTP/1.1 Sep 21 12:24:07.346742 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept: application/json Sep 21 12:24:07.346742 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept-Encoding: identity Sep 21 12:24:07.346742 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Connection: close Sep 21 12:24:07.346742 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Length: 0 Sep 21 12:24:07.346742 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Type: application/json Sep 21 12:24:07.346742 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Host: 10.222.0.71 Sep 21 12:24:07.346742 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Openstack-System-Scope: None Sep 21 12:24:07.346742 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: User-Agent: python-urllib3/1.26.12 Sep 21 12:24:07.346742 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Auth-Token: gAAAAABjKwI1I6BH-IEsMRPJrqJvqUPTpJ_QHYPn5kw1KJB_BqqgQnl470bA0hfm6_BxqFPEJtiGnTpTrGhKU5w7DwMdz36Pz0zqoBxbP6or7ywS-M7PyNaRxbsmBMkpoSvLhzP0zwNBWbylxFrkHpwDqJhwisZHrxNy9STLRezMkQou8dlZRwM Sep 21 12:24:07.346742 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Id: None Sep 21 12:24:07.346742 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Name: None Sep 21 12:24:07.346742 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Identity-Status: Confirmed Sep 21 12:24:07.346742 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Is-Admin-Project: True Sep 21 12:24:07.346742 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Id: default Sep 21 12:24:07.346742 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Name: Default Sep 21 12:24:07.346742 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Id: 1a86f263882a44f385804b84f83d735c Sep 21 12:24:07.346742 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Name: tempest-VolumesNegativeTest-1165175618 Sep 21 12:24:07.346742 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Role: reader,member Sep 21 12:24:07.346742 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Roles: reader,member Sep 21 12:24:07.348477 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/1a86f263882a44f385804b84f83d735c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/1a86f263882a44f385804b84f83d735c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_1a86f263882a44f385804b84f83d735c", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/1a86f263882a44f385804b84f83d735c"}]}] Sep 21 12:24:07.348477 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant: tempest-VolumesNegativeTest-1165175618 Sep 21 12:24:07.348477 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Id: 1a86f263882a44f385804b84f83d735c Sep 21 12:24:07.348477 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Name: tempest-VolumesNegativeTest-1165175618 Sep 21 12:24:07.348477 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User: tempest-VolumesNegativeTest-1165175618-project Sep 21 12:24:07.348477 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Id: default Sep 21 12:24:07.348477 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Name: Default Sep 21 12:24:07.348477 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Id: 0c80648c3936461295821ce1431a4164 Sep 21 12:24:07.348477 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Name: tempest-VolumesNegativeTest-1165175618-project Sep 21 12:24:07.348477 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: method: > Sep 21 12:24:07.348477 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: exception: Instance 714df43c-52c2-426d-a391-bf58f3fa2584 could not be found. Sep 21 12:24:07.348477 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: action_args: {'id': '714df43c-52c2-426d-a391-bf58f3fa2584'} Sep 21 12:24:07.349390 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:24:07.349390 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:24:07.349390 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:24:07.349390 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:24:07.349390 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:24:07.349390 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:24:07.349390 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:24:07.349390 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:24:07.349390 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:24:07.349390 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:24:07.349390 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 714df43c-52c2-426d-a391-bf58f3fa2584 could not be found. Sep 21 12:24:07.349390 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:24:07.349390 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:24:07.349390 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:24:07.349390 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:24:07.349390 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:24:07.349390 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:24:07.349390 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:24:07.349390 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:24:07.349390 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:24:07.350873 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:24:07.350873 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 12:24:07.350873 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 12:24:07.350873 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:24:07.350873 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:24:07.350873 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:24:07.350873 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:24:07.350873 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 714df43c-52c2-426d-a391-bf58f3fa2584 could not be found. Sep 21 12:24:07.350873 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:24:07.350873 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:24:07.350873 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:24:07.350873 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:24:07.350873 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:24:07.350873 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:24:07.350873 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:24:07.350873 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:24:07.350873 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 714df43c-52c2-426d-a391-bf58f3fa2584 could not be found. Sep 21 12:24:07.350873 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:24:07.352173 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-52a71296-739e-410e-b92d-dca759fca346 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] Returning 404 to user: Instance 714df43c-52c2-426d-a391-bf58f3fa2584 could not be found. {{(pid=120463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:24:07.352173 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-52a71296-739e-410e-b92d-dca759fca346 tempest-VolumesNegativeTest-1165175618 tempest-VolumesNegativeTest-1165175618-project] 10.222.0.71 "GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584" status: 404 len: 111 microversion: 2.1 time: 0.080986 Sep 21 12:24:07.363209 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 218/431] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:07 2022] GET /compute/v2.1/servers/714df43c-52c2-426d-a391-bf58f3fa2584 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 21 12:24:07.787907 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-69396027-b613-4ea8-96c8-19f0cdbb180c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:07.801770 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-69396027-b613-4ea8-96c8-19f0cdbb180c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1523 microversion: 2.1 time: 0.690425 Sep 21 12:24:07.803127 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 214/432] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:07 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1523 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:08.834143 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-943a6703-3714-4d06-ac58-5a829fac754a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:08.834819 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-943a6703-3714-4d06-ac58-5a829fac754a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:08.851440 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-943a6703-3714-4d06-ac58-5a829fac754a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:08.852176 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-943a6703-3714-4d06-ac58-5a829fac754a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:08.852815 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-943a6703-3714-4d06-ac58-5a829fac754a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:08.853702 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-943a6703-3714-4d06-ac58-5a829fac754a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:08.854511 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-943a6703-3714-4d06-ac58-5a829fac754a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:08.855731 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-943a6703-3714-4d06-ac58-5a829fac754a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:09.085460 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-943a6703-3714-4d06-ac58-5a829fac754a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:09.093596 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-943a6703-3714-4d06-ac58-5a829fac754a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1523 microversion: 2.1 time: 0.269753 Sep 21 12:24:09.095381 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 219/433] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:08 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1523 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:10.123298 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-33bf8a99-b893-4c2e-b21f-fbd7c55a6544 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:10.124358 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-33bf8a99-b893-4c2e-b21f-fbd7c55a6544 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:10.131824 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-33bf8a99-b893-4c2e-b21f-fbd7c55a6544 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:10.132642 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-33bf8a99-b893-4c2e-b21f-fbd7c55a6544 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:10.134073 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-33bf8a99-b893-4c2e-b21f-fbd7c55a6544 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:10.134073 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-33bf8a99-b893-4c2e-b21f-fbd7c55a6544 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:10.134645 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-33bf8a99-b893-4c2e-b21f-fbd7c55a6544 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:10.135285 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-33bf8a99-b893-4c2e-b21f-fbd7c55a6544 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:10.407741 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-33bf8a99-b893-4c2e-b21f-fbd7c55a6544 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:10.426897 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-33bf8a99-b893-4c2e-b21f-fbd7c55a6544 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1523 microversion: 2.1 time: 0.311131 Sep 21 12:24:10.443635 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 215/434] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:10 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1523 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:11.455524 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-958ef14d-dbe5-421a-8659-13df9b41313b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:11.456715 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-958ef14d-dbe5-421a-8659-13df9b41313b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:11.473149 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-958ef14d-dbe5-421a-8659-13df9b41313b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:11.479698 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-958ef14d-dbe5-421a-8659-13df9b41313b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:11.480207 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-958ef14d-dbe5-421a-8659-13df9b41313b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:11.480966 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-958ef14d-dbe5-421a-8659-13df9b41313b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:11.481495 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-958ef14d-dbe5-421a-8659-13df9b41313b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:11.484495 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-958ef14d-dbe5-421a-8659-13df9b41313b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:11.852640 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-958ef14d-dbe5-421a-8659-13df9b41313b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:11.878098 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-958ef14d-dbe5-421a-8659-13df9b41313b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1523 microversion: 2.1 time: 0.429778 Sep 21 12:24:11.882965 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 220/435] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:11 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1523 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:12.944026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-0c66630b-f3b0-4359-baa4-65436151c68b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:12.944741 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-0c66630b-f3b0-4359-baa4-65436151c68b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:12.950924 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 21 12:24:12.951538 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Wed Sep 21 12:24:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb (ip 10.222.0.71) !!! Sep 21 12:24:12.959594 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0c66630b-f3b0-4359-baa4-65436151c68b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:12.961975 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0c66630b-f3b0-4359-baa4-65436151c68b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:12.965170 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0c66630b-f3b0-4359-baa4-65436151c68b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:12.966000 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0c66630b-f3b0-4359-baa4-65436151c68b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:12.966590 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0c66630b-f3b0-4359-baa4-65436151c68b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:12.967220 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0c66630b-f3b0-4359-baa4-65436151c68b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:13.203276 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-0c66630b-f3b0-4359-baa4-65436151c68b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:13.218579 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-0c66630b-f3b0-4359-baa4-65436151c68b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1523 microversion: 2.1 time: 0.280489 Sep 21 12:24:13.219170 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 216/436] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:12 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1523 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:14.242504 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-6ff68d2a-a858-4d55-b3ec-dd5502aca167 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:14.243127 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-6ff68d2a-a858-4d55-b3ec-dd5502aca167 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:14.250710 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6ff68d2a-a858-4d55-b3ec-dd5502aca167 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:14.251207 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6ff68d2a-a858-4d55-b3ec-dd5502aca167 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:14.251647 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6ff68d2a-a858-4d55-b3ec-dd5502aca167 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:14.256572 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6ff68d2a-a858-4d55-b3ec-dd5502aca167 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:14.262692 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6ff68d2a-a858-4d55-b3ec-dd5502aca167 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:14.263422 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6ff68d2a-a858-4d55-b3ec-dd5502aca167 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:14.268823 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:14.607218 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-6ff68d2a-a858-4d55-b3ec-dd5502aca167 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:14.660828 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-6ff68d2a-a858-4d55-b3ec-dd5502aca167 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1523 microversion: 2.1 time: 0.422144 Sep 21 12:24:14.661928 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 221/437] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:14 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1523 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:15.687140 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-0589518a-abdd-4980-922e-dc08e633fd3f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:15.688986 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-0589518a-abdd-4980-922e-dc08e633fd3f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:15.695966 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0589518a-abdd-4980-922e-dc08e633fd3f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:15.696688 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0589518a-abdd-4980-922e-dc08e633fd3f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:15.697118 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0589518a-abdd-4980-922e-dc08e633fd3f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:15.697985 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0589518a-abdd-4980-922e-dc08e633fd3f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:15.698435 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0589518a-abdd-4980-922e-dc08e633fd3f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:15.698860 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0589518a-abdd-4980-922e-dc08e633fd3f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:15.871796 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-0589518a-abdd-4980-922e-dc08e633fd3f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:15.882921 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-0589518a-abdd-4980-922e-dc08e633fd3f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1523 microversion: 2.1 time: 0.199365 Sep 21 12:24:15.884054 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 217/438] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:15 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:16.906578 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-43280f30-3909-47e5-9ee1-b87cfb480b72 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:16.908113 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-43280f30-3909-47e5-9ee1-b87cfb480b72 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:16.920673 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-43280f30-3909-47e5-9ee1-b87cfb480b72 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:16.921163 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-43280f30-3909-47e5-9ee1-b87cfb480b72 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:16.921778 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-43280f30-3909-47e5-9ee1-b87cfb480b72 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:16.922804 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-43280f30-3909-47e5-9ee1-b87cfb480b72 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:16.923426 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-43280f30-3909-47e5-9ee1-b87cfb480b72 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:16.924037 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-43280f30-3909-47e5-9ee1-b87cfb480b72 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:17.214585 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-43280f30-3909-47e5-9ee1-b87cfb480b72 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:17.224998 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-43280f30-3909-47e5-9ee1-b87cfb480b72 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1523 microversion: 2.1 time: 0.322148 Sep 21 12:24:17.226314 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 222/439] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:16 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1523 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:18.255597 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-5000c321-f17c-4c41-a067-685f2f3bc776 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:18.257021 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-5000c321-f17c-4c41-a067-685f2f3bc776 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:18.272419 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5000c321-f17c-4c41-a067-685f2f3bc776 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:18.273400 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5000c321-f17c-4c41-a067-685f2f3bc776 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:18.274133 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5000c321-f17c-4c41-a067-685f2f3bc776 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:18.275629 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5000c321-f17c-4c41-a067-685f2f3bc776 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:18.276340 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5000c321-f17c-4c41-a067-685f2f3bc776 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:18.277004 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5000c321-f17c-4c41-a067-685f2f3bc776 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:18.545430 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-5000c321-f17c-4c41-a067-685f2f3bc776 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:18.556867 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-5000c321-f17c-4c41-a067-685f2f3bc776 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1523 microversion: 2.1 time: 0.306832 Sep 21 12:24:18.557552 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 218/440] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:18 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1523 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:19.609000 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-d2d306aa-daa3-4407-a6e2-f7d0194d56dd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:19.609964 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-d2d306aa-daa3-4407-a6e2-f7d0194d56dd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:19.634017 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d2d306aa-daa3-4407-a6e2-f7d0194d56dd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:19.640753 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d2d306aa-daa3-4407-a6e2-f7d0194d56dd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:19.644922 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d2d306aa-daa3-4407-a6e2-f7d0194d56dd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:19.645697 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d2d306aa-daa3-4407-a6e2-f7d0194d56dd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:19.646184 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d2d306aa-daa3-4407-a6e2-f7d0194d56dd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:19.646624 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d2d306aa-daa3-4407-a6e2-f7d0194d56dd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:19.833984 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-d2d306aa-daa3-4407-a6e2-f7d0194d56dd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:19.842061 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-d2d306aa-daa3-4407-a6e2-f7d0194d56dd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1503 microversion: 2.1 time: 0.264389 Sep 21 12:24:19.843248 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 223/441] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:19 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1503 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:19.865286 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-987f2420-2b37-41d8-8709-8e5a69c44ba0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:19.865904 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-987f2420-2b37-41d8-8709-8e5a69c44ba0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:19.874497 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-987f2420-2b37-41d8-8709-8e5a69c44ba0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:19.875292 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-987f2420-2b37-41d8-8709-8e5a69c44ba0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:19.876640 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-987f2420-2b37-41d8-8709-8e5a69c44ba0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:19.877582 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-987f2420-2b37-41d8-8709-8e5a69c44ba0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:19.878778 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-987f2420-2b37-41d8-8709-8e5a69c44ba0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:19.879517 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-987f2420-2b37-41d8-8709-8e5a69c44ba0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:20.044037 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-987f2420-2b37-41d8-8709-8e5a69c44ba0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:20.051620 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-987f2420-2b37-41d8-8709-8e5a69c44ba0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1517 microversion: 2.1 time: 0.190261 Sep 21 12:24:20.052218 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 219/442] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:19 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1517 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:21.937210 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-2869da97-de33-462a-939f-4b9a2d83e659 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:24:21.941789 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-2869da97-de33-462a-939f-4b9a2d83e659 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:21.948826 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 21 12:24:21.949248 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Wed Sep 21 12:24:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a/action (ip 10.222.0.71) !!! Sep 21 12:24:21.951293 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2869da97-de33-462a-939f-4b9a2d83e659 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:21.952107 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2869da97-de33-462a-939f-4b9a2d83e659 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:21.952787 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2869da97-de33-462a-939f-4b9a2d83e659 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:21.953714 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2869da97-de33-462a-939f-4b9a2d83e659 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:21.954620 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2869da97-de33-462a-939f-4b9a2d83e659 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:21.955246 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2869da97-de33-462a-939f-4b9a2d83e659 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:21.987317 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.objects.instance [None req-2869da97-de33-462a-939f-4b9a2d83e659 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lazy-loading 'flavor' on Instance uuid 5560ddde-2668-4e31-bbbf-b94d7485df5a {{(pid=120463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 12:24:22.112072 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-2869da97-de33-462a-939f-4b9a2d83e659 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "POST /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a/action" status: 200 len: 32 microversion: 2.1 time: 0.178622 Sep 21 12:24:22.116731 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 224/443] 10.222.0.71 () {60 vars in 1278 bytes} [Wed Sep 21 12:24:21 2022] POST /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a/action => generated 32 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 21 12:24:22.122370 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-31120d25-11c8-4c42-9049-07ccfd5b3b1a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:22.122973 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-31120d25-11c8-4c42-9049-07ccfd5b3b1a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:22.129609 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-31120d25-11c8-4c42-9049-07ccfd5b3b1a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:22.130506 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-31120d25-11c8-4c42-9049-07ccfd5b3b1a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:22.131223 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-31120d25-11c8-4c42-9049-07ccfd5b3b1a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:22.132194 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-31120d25-11c8-4c42-9049-07ccfd5b3b1a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:22.132842 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-31120d25-11c8-4c42-9049-07ccfd5b3b1a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:22.133605 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-31120d25-11c8-4c42-9049-07ccfd5b3b1a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:22.304689 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-31120d25-11c8-4c42-9049-07ccfd5b3b1a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:22.314500 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-31120d25-11c8-4c42-9049-07ccfd5b3b1a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1523 microversion: 2.1 time: 0.195964 Sep 21 12:24:22.320934 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 220/444] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:22 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1523 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:23.345495 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-7801664c-5053-4400-ae7d-96c391bae3ac tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:23.346202 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-7801664c-5053-4400-ae7d-96c391bae3ac tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:23.348413 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:23.365768 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7801664c-5053-4400-ae7d-96c391bae3ac tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:23.366537 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7801664c-5053-4400-ae7d-96c391bae3ac tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:23.370131 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7801664c-5053-4400-ae7d-96c391bae3ac tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:23.371384 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7801664c-5053-4400-ae7d-96c391bae3ac tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:23.372427 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7801664c-5053-4400-ae7d-96c391bae3ac tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:23.373321 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7801664c-5053-4400-ae7d-96c391bae3ac tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:23.555628 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-7801664c-5053-4400-ae7d-96c391bae3ac tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:23.565195 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-7801664c-5053-4400-ae7d-96c391bae3ac tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1523 microversion: 2.1 time: 0.224809 Sep 21 12:24:23.566502 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 225/445] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:23 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:24.602000 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-f21a2435-f6eb-4c6b-a2d0-28a815beb93d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:24.603268 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-f21a2435-f6eb-4c6b-a2d0-28a815beb93d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:24.611250 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f21a2435-f6eb-4c6b-a2d0-28a815beb93d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:24.611744 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f21a2435-f6eb-4c6b-a2d0-28a815beb93d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:24.612206 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f21a2435-f6eb-4c6b-a2d0-28a815beb93d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:24.612956 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f21a2435-f6eb-4c6b-a2d0-28a815beb93d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:24.613405 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f21a2435-f6eb-4c6b-a2d0-28a815beb93d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:24.613842 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f21a2435-f6eb-4c6b-a2d0-28a815beb93d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:24.765820 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-f21a2435-f6eb-4c6b-a2d0-28a815beb93d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:24.773105 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-f21a2435-f6eb-4c6b-a2d0-28a815beb93d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1523 microversion: 2.1 time: 0.174916 Sep 21 12:24:24.773672 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 221/446] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:24 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:24:25.800361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-e8fcd120-9994-4b28-92ad-be150046936c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:25.800972 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-e8fcd120-9994-4b28-92ad-be150046936c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:25.809933 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e8fcd120-9994-4b28-92ad-be150046936c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:25.811328 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e8fcd120-9994-4b28-92ad-be150046936c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:25.811785 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e8fcd120-9994-4b28-92ad-be150046936c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:25.813085 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e8fcd120-9994-4b28-92ad-be150046936c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:25.813727 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e8fcd120-9994-4b28-92ad-be150046936c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:25.814851 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e8fcd120-9994-4b28-92ad-be150046936c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:25.971312 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-e8fcd120-9994-4b28-92ad-be150046936c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:25.981857 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-e8fcd120-9994-4b28-92ad-be150046936c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1523 microversion: 2.1 time: 0.186898 Sep 21 12:24:25.994756 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 226/447] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:25 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:27.006694 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-f4e5eb10-f360-4a0d-be84-6c3bd96d96ba tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:27.008069 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-f4e5eb10-f360-4a0d-be84-6c3bd96d96ba tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:27.014714 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_api:SELECT=36 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:27.016676 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f4e5eb10-f360-4a0d-be84-6c3bd96d96ba tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:27.017345 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f4e5eb10-f360-4a0d-be84-6c3bd96d96ba tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:27.017963 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f4e5eb10-f360-4a0d-be84-6c3bd96d96ba tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:27.019538 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f4e5eb10-f360-4a0d-be84-6c3bd96d96ba tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:27.020042 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f4e5eb10-f360-4a0d-be84-6c3bd96d96ba tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:27.020616 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f4e5eb10-f360-4a0d-be84-6c3bd96d96ba tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:27.172149 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-f4e5eb10-f360-4a0d-be84-6c3bd96d96ba tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:27.180448 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-f4e5eb10-f360-4a0d-be84-6c3bd96d96ba tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1523 microversion: 2.1 time: 0.177812 Sep 21 12:24:27.181541 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 222/448] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:27 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:28.205657 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-96296ebb-71a0-4669-8910-e244e27cb983 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:28.206455 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-96296ebb-71a0-4669-8910-e244e27cb983 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:28.213446 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-96296ebb-71a0-4669-8910-e244e27cb983 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:28.214019 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-96296ebb-71a0-4669-8910-e244e27cb983 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:28.214524 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-96296ebb-71a0-4669-8910-e244e27cb983 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:28.216183 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-96296ebb-71a0-4669-8910-e244e27cb983 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:28.216762 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-96296ebb-71a0-4669-8910-e244e27cb983 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:28.217190 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-96296ebb-71a0-4669-8910-e244e27cb983 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:28.357152 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-96296ebb-71a0-4669-8910-e244e27cb983 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:28.365523 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-96296ebb-71a0-4669-8910-e244e27cb983 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1523 microversion: 2.1 time: 0.164324 Sep 21 12:24:28.366309 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 227/449] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:28 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:29.377204 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-96d55e60-e3a7-41ee-a7c9-5e3abb99e060 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Action: 'create', calling method: .version_select at 0x7fe4c90bcf70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-325051845", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJEyik+OVL8C451svsnwZSgHDpg53siagxU08aLDO8Qf6Qf8RsXZG/79y+DBxBEQpOg06u2Px01taI5K/CIkHiqXPFFuTpXX4hZbpOLoFm+MfvaBjiiTgePIRJ0fg16KWw=="}} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:24:29.387524 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-1e4463a5-0780-4351-bf88-eec4f3631d75 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:29.388282 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-1e4463a5-0780-4351-bf88-eec4f3631d75 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:29.393178 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-96d55e60-e3a7-41ee-a7c9-5e3abb99e060 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Getting quotas for project 9de710fda38c429a91595545e9a74dcb. Resources: {'key_pairs'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 12:24:29.394508 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1e4463a5-0780-4351-bf88-eec4f3631d75 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:29.395003 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1e4463a5-0780-4351-bf88-eec4f3631d75 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:29.395450 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1e4463a5-0780-4351-bf88-eec4f3631d75 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:29.396177 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1e4463a5-0780-4351-bf88-eec4f3631d75 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:29.396641 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1e4463a5-0780-4351-bf88-eec4f3631d75 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:29.397075 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1e4463a5-0780-4351-bf88-eec4f3631d75 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:29.397233 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-96d55e60-e3a7-41ee-a7c9-5e3abb99e060 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Getting quotas for user 8e0b6c8f5ec24d478f47a3d8d2fd941e and project 9de710fda38c429a91595545e9a74dcb. Resources: {'key_pairs'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 12:24:29.424321 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-96d55e60-e3a7-41ee-a7c9-5e3abb99e060 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.050834 Sep 21 12:24:29.431803 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 223/450] 10.222.0.71 () {60 vars in 1159 bytes} [Wed Sep 21 12:24:29 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:24:29.480938 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-ee9e9953-a0f2-4e3a-9cdc-c450cc12f052 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1836819423", "imageRef": "1ddca6da-f468-4f4d-9ef1-24b048ba36d5", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-325051845", "networks": [{"uuid": "e392466d-8ee6-4b86-9e48-53d3cb8a545c"}]}} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:24:29.534094 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-1e4463a5-0780-4351-bf88-eec4f3631d75 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:29.540916 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.network.neutron [None req-ee9e9953-a0f2-4e3a-9cdc-c450cc12f052 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] validate_networks() for [('e392466d-8ee6-4b86-9e48-53d3cb8a545c', None, None, None, None, None)] {{(pid=120462) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 12:24:29.542040 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-1e4463a5-0780-4351-bf88-eec4f3631d75 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1523 microversion: 2.1 time: 0.158322 Sep 21 12:24:29.542607 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 228/451] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:29 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:24:29.916140 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-ee9e9953-a0f2-4e3a-9cdc-c450cc12f052 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Flavor limits 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 12:24:29.916573 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-ee9e9953-a0f2-4e3a-9cdc-c450cc12f052 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Image limits 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 12:24:29.917081 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-ee9e9953-a0f2-4e3a-9cdc-c450cc12f052 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Flavor pref 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 12:24:29.917493 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-ee9e9953-a0f2-4e3a-9cdc-c450cc12f052 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Image pref 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 12:24:29.917972 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-ee9e9953-a0f2-4e3a-9cdc-c450cc12f052 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 12:24:29.926858 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ee9e9953-a0f2-4e3a-9cdc-c450cc12f052 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:29.927344 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ee9e9953-a0f2-4e3a-9cdc-c450cc12f052 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:29.927814 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ee9e9953-a0f2-4e3a-9cdc-c450cc12f052 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:29.928554 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ee9e9953-a0f2-4e3a-9cdc-c450cc12f052 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:29.929016 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ee9e9953-a0f2-4e3a-9cdc-c450cc12f052 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:29.929455 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ee9e9953-a0f2-4e3a-9cdc-c450cc12f052 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:29.946347 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-ee9e9953-a0f2-4e3a-9cdc-c450cc12f052 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Getting quotas for project 9de710fda38c429a91595545e9a74dcb. Resources: {'instances', 'ram', 'cores'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 12:24:29.950948 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-ee9e9953-a0f2-4e3a-9cdc-c450cc12f052 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Getting quotas for user 8e0b6c8f5ec24d478f47a3d8d2fd941e and project 9de710fda38c429a91595545e9a74dcb. Resources: {'instances', 'ram', 'cores'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 12:24:29.962086 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-ee9e9953-a0f2-4e3a-9cdc-c450cc12f052 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Going to run 1 instances... {{(pid=120462) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 12:24:29.964330 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-ee9e9953-a0f2-4e3a-9cdc-c450cc12f052 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1ddca6da-f468-4f4d-9ef1-24b048ba36d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 12:24:30.010309 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-ee9e9953-a0f2-4e3a-9cdc-c450cc12f052 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533808 Sep 21 12:24:30.011035 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 224/452] 10.222.0.71 () {60 vars in 1147 bytes} [Wed Sep 21 12:24:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 21 12:24:30.022831 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-be7fbbe1-ec88-4edd-8d6a-781ee5845fb3 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:30.023529 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-be7fbbe1-ec88-4edd-8d6a-781ee5845fb3 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:30.078102 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-be7fbbe1-ec88-4edd-8d6a-781ee5845fb3 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:30.087595 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-be7fbbe1-ec88-4edd-8d6a-781ee5845fb3 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1258 microversion: 2.1 time: 0.068726 Sep 21 12:24:30.088543 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 229/453] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:30 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:30.567920 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-43f0528a-5b44-41de-ae83-f677ab01e78d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:30.568550 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-43f0528a-5b44-41de-ae83-f677ab01e78d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:30.577231 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-43f0528a-5b44-41de-ae83-f677ab01e78d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:30.577728 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-43f0528a-5b44-41de-ae83-f677ab01e78d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:30.578183 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-43f0528a-5b44-41de-ae83-f677ab01e78d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:30.578894 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-43f0528a-5b44-41de-ae83-f677ab01e78d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:30.579613 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-43f0528a-5b44-41de-ae83-f677ab01e78d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:30.580069 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-43f0528a-5b44-41de-ae83-f677ab01e78d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:30.713027 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-43f0528a-5b44-41de-ae83-f677ab01e78d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:30.722703 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-43f0528a-5b44-41de-ae83-f677ab01e78d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1523 microversion: 2.1 time: 0.160668 Sep 21 12:24:30.723275 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 225/454] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:30 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:31.111374 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-1ec01819-3fc5-4daa-9b34-190bb199e9e6 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:31.112024 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-1ec01819-3fc5-4daa-9b34-190bb199e9e6 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:31.119499 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1ec01819-3fc5-4daa-9b34-190bb199e9e6 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:31.120034 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1ec01819-3fc5-4daa-9b34-190bb199e9e6 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:31.120477 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1ec01819-3fc5-4daa-9b34-190bb199e9e6 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:31.121240 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1ec01819-3fc5-4daa-9b34-190bb199e9e6 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:31.121916 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1ec01819-3fc5-4daa-9b34-190bb199e9e6 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:31.122532 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1ec01819-3fc5-4daa-9b34-190bb199e9e6 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:31.181606 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-1ec01819-3fc5-4daa-9b34-190bb199e9e6 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:31.189216 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-1ec01819-3fc5-4daa-9b34-190bb199e9e6 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1310 microversion: 2.1 time: 0.081766 Sep 21 12:24:31.189790 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 230/455] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:31 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1310 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:31.748390 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-76c32d64-ccb0-49ca-8da7-09fcf7f175d2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:31.748955 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-76c32d64-ccb0-49ca-8da7-09fcf7f175d2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:31.754779 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-76c32d64-ccb0-49ca-8da7-09fcf7f175d2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:31.755397 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-76c32d64-ccb0-49ca-8da7-09fcf7f175d2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:31.755885 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-76c32d64-ccb0-49ca-8da7-09fcf7f175d2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:31.756763 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-76c32d64-ccb0-49ca-8da7-09fcf7f175d2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:31.757255 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-76c32d64-ccb0-49ca-8da7-09fcf7f175d2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:31.757684 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-76c32d64-ccb0-49ca-8da7-09fcf7f175d2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:31.869593 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-8e8dd66c-90fd-4fc7-9660-fb24ca35a6e6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:31.870654 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-8e8dd66c-90fd-4fc7-9660-fb24ca35a6e6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:31.878069 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8e8dd66c-90fd-4fc7-9660-fb24ca35a6e6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:31.878579 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8e8dd66c-90fd-4fc7-9660-fb24ca35a6e6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:31.879246 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8e8dd66c-90fd-4fc7-9660-fb24ca35a6e6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:31.880121 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8e8dd66c-90fd-4fc7-9660-fb24ca35a6e6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:31.881108 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8e8dd66c-90fd-4fc7-9660-fb24ca35a6e6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:31.881550 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8e8dd66c-90fd-4fc7-9660-fb24ca35a6e6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:31.908293 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-8e8dd66c-90fd-4fc7-9660-fb24ca35a6e6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e/ips" status: 200 len: 153 microversion: 2.20 time: 0.043110 Sep 21 12:24:31.908646 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 231/456] 10.222.0.71 () {60 vars in 1289 bytes} [Wed Sep 21 12:24:31 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e/ips => generated 153 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 12:24:31.976644 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-76c32d64-ccb0-49ca-8da7-09fcf7f175d2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:31.991607 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-76c32d64-ccb0-49ca-8da7-09fcf7f175d2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1523 microversion: 2.1 time: 0.246857 Sep 21 12:24:31.994458 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 226/457] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:31 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1523 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:32.213631 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-5f2aacd3-7487-499c-beb5-b230873b5511 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:32.214263 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-5f2aacd3-7487-499c-beb5-b230873b5511 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:32.221704 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5f2aacd3-7487-499c-beb5-b230873b5511 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:32.222423 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5f2aacd3-7487-499c-beb5-b230873b5511 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:32.222874 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5f2aacd3-7487-499c-beb5-b230873b5511 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:32.223546 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5f2aacd3-7487-499c-beb5-b230873b5511 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:32.224190 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5f2aacd3-7487-499c-beb5-b230873b5511 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:32.224615 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5f2aacd3-7487-499c-beb5-b230873b5511 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:32.384014 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-5f2aacd3-7487-499c-beb5-b230873b5511 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:32.394131 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-5f2aacd3-7487-499c-beb5-b230873b5511 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1358 microversion: 2.1 time: 0.184218 Sep 21 12:24:32.394721 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 232/458] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:32 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:33.020203 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-f3060532-333a-4c2b-b092-266ba92c8fea tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:33.020742 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-f3060532-333a-4c2b-b092-266ba92c8fea tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:33.026639 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f3060532-333a-4c2b-b092-266ba92c8fea tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:33.027120 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f3060532-333a-4c2b-b092-266ba92c8fea tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:33.027558 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f3060532-333a-4c2b-b092-266ba92c8fea tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:33.028281 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f3060532-333a-4c2b-b092-266ba92c8fea tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:33.028775 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f3060532-333a-4c2b-b092-266ba92c8fea tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:33.029201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f3060532-333a-4c2b-b092-266ba92c8fea tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:33.172094 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-f3060532-333a-4c2b-b092-266ba92c8fea tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:33.182245 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-f3060532-333a-4c2b-b092-266ba92c8fea tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1523 microversion: 2.1 time: 0.165842 Sep 21 12:24:33.182942 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 227/459] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:33 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:33.421130 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-8404c4dc-3cdb-4229-bcf8-129cc58b268d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:33.422791 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-8404c4dc-3cdb-4229-bcf8-129cc58b268d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:33.430570 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8404c4dc-3cdb-4229-bcf8-129cc58b268d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:33.431424 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8404c4dc-3cdb-4229-bcf8-129cc58b268d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:33.432441 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8404c4dc-3cdb-4229-bcf8-129cc58b268d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:33.433400 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8404c4dc-3cdb-4229-bcf8-129cc58b268d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:33.434080 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8404c4dc-3cdb-4229-bcf8-129cc58b268d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:33.435358 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8404c4dc-3cdb-4229-bcf8-129cc58b268d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:33.566995 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-8404c4dc-3cdb-4229-bcf8-129cc58b268d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:33.574693 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-8404c4dc-3cdb-4229-bcf8-129cc58b268d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1358 microversion: 2.1 time: 0.158675 Sep 21 12:24:33.575266 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 233/460] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:33 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:34.207226 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-9aa1157f-a36c-4d90-8e7c-c92b0cbd2612 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:34.207880 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-9aa1157f-a36c-4d90-8e7c-c92b0cbd2612 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:34.214804 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9aa1157f-a36c-4d90-8e7c-c92b0cbd2612 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:34.215320 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9aa1157f-a36c-4d90-8e7c-c92b0cbd2612 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:34.215783 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9aa1157f-a36c-4d90-8e7c-c92b0cbd2612 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:34.216696 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9aa1157f-a36c-4d90-8e7c-c92b0cbd2612 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:34.217794 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9aa1157f-a36c-4d90-8e7c-c92b0cbd2612 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:34.218383 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9aa1157f-a36c-4d90-8e7c-c92b0cbd2612 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:34.351308 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-9aa1157f-a36c-4d90-8e7c-c92b0cbd2612 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:34.359022 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-9aa1157f-a36c-4d90-8e7c-c92b0cbd2612 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1523 microversion: 2.1 time: 0.155947 Sep 21 12:24:34.359588 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 228/461] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:34 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:34.597540 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-660fbc76-23d5-4b48-a381-624f5d8b5b51 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:34.598156 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-660fbc76-23d5-4b48-a381-624f5d8b5b51 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:34.604615 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-660fbc76-23d5-4b48-a381-624f5d8b5b51 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:34.605177 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-660fbc76-23d5-4b48-a381-624f5d8b5b51 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:34.605618 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-660fbc76-23d5-4b48-a381-624f5d8b5b51 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:34.606313 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-660fbc76-23d5-4b48-a381-624f5d8b5b51 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:34.606767 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-660fbc76-23d5-4b48-a381-624f5d8b5b51 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:34.607204 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-660fbc76-23d5-4b48-a381-624f5d8b5b51 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:34.753455 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-660fbc76-23d5-4b48-a381-624f5d8b5b51 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:34.768272 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-660fbc76-23d5-4b48-a381-624f5d8b5b51 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1358 microversion: 2.1 time: 0.174428 Sep 21 12:24:34.768965 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 234/462] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:34 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:35.224842 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-ae0ef2c4-9d6b-4a50-8eaf-fe25f3a6833a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:35.225975 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-ae0ef2c4-9d6b-4a50-8eaf-fe25f3a6833a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:35.233395 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ae0ef2c4-9d6b-4a50-8eaf-fe25f3a6833a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:35.234205 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ae0ef2c4-9d6b-4a50-8eaf-fe25f3a6833a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:35.234801 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ae0ef2c4-9d6b-4a50-8eaf-fe25f3a6833a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:35.236381 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ae0ef2c4-9d6b-4a50-8eaf-fe25f3a6833a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:35.237136 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ae0ef2c4-9d6b-4a50-8eaf-fe25f3a6833a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:35.237726 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ae0ef2c4-9d6b-4a50-8eaf-fe25f3a6833a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:35.262623 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-ae0ef2c4-9d6b-4a50-8eaf-fe25f3a6833a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e/ips" status: 200 len: 144 microversion: 2.1 time: 0.041579 Sep 21 12:24:35.263201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 229/463] 10.222.0.71 () {58 vars in 1248 bytes} [Wed Sep 21 12:24:35 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e/ips => generated 144 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 12:24:35.382401 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-59346795-fec9-4606-8833-3b91c76d30d8 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:35.383011 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-59346795-fec9-4606-8833-3b91c76d30d8 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:35.388927 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-59346795-fec9-4606-8833-3b91c76d30d8 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:35.389412 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-59346795-fec9-4606-8833-3b91c76d30d8 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:35.389853 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-59346795-fec9-4606-8833-3b91c76d30d8 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:35.390539 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-59346795-fec9-4606-8833-3b91c76d30d8 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:35.390994 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-59346795-fec9-4606-8833-3b91c76d30d8 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:35.391423 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-59346795-fec9-4606-8833-3b91c76d30d8 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:35.520602 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-59346795-fec9-4606-8833-3b91c76d30d8 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:35.528385 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-59346795-fec9-4606-8833-3b91c76d30d8 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1523 microversion: 2.1 time: 0.149851 Sep 21 12:24:35.528964 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 235/464] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:35 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:35.791023 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-1fb2824e-96b2-4c92-ad97-289db2ef8095 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:35.791628 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-1fb2824e-96b2-4c92-ad97-289db2ef8095 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:35.797686 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1fb2824e-96b2-4c92-ad97-289db2ef8095 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:35.798166 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1fb2824e-96b2-4c92-ad97-289db2ef8095 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:35.798592 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1fb2824e-96b2-4c92-ad97-289db2ef8095 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:35.799273 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1fb2824e-96b2-4c92-ad97-289db2ef8095 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:35.799720 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1fb2824e-96b2-4c92-ad97-289db2ef8095 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:35.800165 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1fb2824e-96b2-4c92-ad97-289db2ef8095 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:35.952253 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-1fb2824e-96b2-4c92-ad97-289db2ef8095 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:35.964436 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-1fb2824e-96b2-4c92-ad97-289db2ef8095 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1358 microversion: 2.1 time: 0.177130 Sep 21 12:24:35.965843 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 230/465] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:35 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:36.551709 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-1b1cd63f-8371-4f2b-a921-c46774680b76 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:36.552345 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-1b1cd63f-8371-4f2b-a921-c46774680b76 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:36.558737 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1b1cd63f-8371-4f2b-a921-c46774680b76 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:36.559217 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1b1cd63f-8371-4f2b-a921-c46774680b76 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:36.559651 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1b1cd63f-8371-4f2b-a921-c46774680b76 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:36.560433 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1b1cd63f-8371-4f2b-a921-c46774680b76 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:36.561425 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1b1cd63f-8371-4f2b-a921-c46774680b76 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:36.561987 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1b1cd63f-8371-4f2b-a921-c46774680b76 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:36.706430 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-1b1cd63f-8371-4f2b-a921-c46774680b76 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:36.714120 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-1b1cd63f-8371-4f2b-a921-c46774680b76 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1523 microversion: 2.1 time: 0.166212 Sep 21 12:24:36.714695 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 236/466] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:36 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:36.988223 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-fcd83237-4c4f-41c5-a4c6-4c0e49b5d002 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:36.988830 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-fcd83237-4c4f-41c5-a4c6-4c0e49b5d002 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:36.994751 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fcd83237-4c4f-41c5-a4c6-4c0e49b5d002 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:36.995222 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fcd83237-4c4f-41c5-a4c6-4c0e49b5d002 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:36.995655 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fcd83237-4c4f-41c5-a4c6-4c0e49b5d002 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:36.996360 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fcd83237-4c4f-41c5-a4c6-4c0e49b5d002 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:36.996809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fcd83237-4c4f-41c5-a4c6-4c0e49b5d002 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:36.997229 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fcd83237-4c4f-41c5-a4c6-4c0e49b5d002 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:37.000665 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=92 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:37.126248 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-fcd83237-4c4f-41c5-a4c6-4c0e49b5d002 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:37.133765 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-fcd83237-4c4f-41c5-a4c6-4c0e49b5d002 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1358 microversion: 2.1 time: 0.149437 Sep 21 12:24:37.134326 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 231/467] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:36 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:37.737345 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-37e6d5ae-c93f-4d9a-b13c-99fb93574932 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:37.738027 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-37e6d5ae-c93f-4d9a-b13c-99fb93574932 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:37.744599 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-37e6d5ae-c93f-4d9a-b13c-99fb93574932 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:37.745094 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-37e6d5ae-c93f-4d9a-b13c-99fb93574932 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:37.745536 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-37e6d5ae-c93f-4d9a-b13c-99fb93574932 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:37.746242 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-37e6d5ae-c93f-4d9a-b13c-99fb93574932 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:37.746696 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-37e6d5ae-c93f-4d9a-b13c-99fb93574932 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:37.747125 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-37e6d5ae-c93f-4d9a-b13c-99fb93574932 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:37.751825 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:37.879366 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-37e6d5ae-c93f-4d9a-b13c-99fb93574932 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:37.887127 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-37e6d5ae-c93f-4d9a-b13c-99fb93574932 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1523 microversion: 2.1 time: 0.153728 Sep 21 12:24:37.887700 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 237/468] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:37 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:38.157630 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-06b0b90f-7cb1-42ee-aeea-db14ad657aa2 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:38.158248 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-06b0b90f-7cb1-42ee-aeea-db14ad657aa2 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:38.164279 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-06b0b90f-7cb1-42ee-aeea-db14ad657aa2 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:38.164794 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-06b0b90f-7cb1-42ee-aeea-db14ad657aa2 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:38.165228 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-06b0b90f-7cb1-42ee-aeea-db14ad657aa2 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:38.165921 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-06b0b90f-7cb1-42ee-aeea-db14ad657aa2 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:38.166378 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-06b0b90f-7cb1-42ee-aeea-db14ad657aa2 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:38.166807 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-06b0b90f-7cb1-42ee-aeea-db14ad657aa2 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:38.303252 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-06b0b90f-7cb1-42ee-aeea-db14ad657aa2 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:38.310914 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-06b0b90f-7cb1-42ee-aeea-db14ad657aa2 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1358 microversion: 2.1 time: 0.157835 Sep 21 12:24:38.311469 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 232/469] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:38 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:38.910539 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-ace9e6da-c84e-4236-bc56-64029602e5c5 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:38.911086 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-ace9e6da-c84e-4236-bc56-64029602e5c5 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:38.917730 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ace9e6da-c84e-4236-bc56-64029602e5c5 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:38.918220 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ace9e6da-c84e-4236-bc56-64029602e5c5 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:38.918655 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ace9e6da-c84e-4236-bc56-64029602e5c5 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:38.919346 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ace9e6da-c84e-4236-bc56-64029602e5c5 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:38.919824 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ace9e6da-c84e-4236-bc56-64029602e5c5 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:38.920246 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ace9e6da-c84e-4236-bc56-64029602e5c5 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:39.068719 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-ace9e6da-c84e-4236-bc56-64029602e5c5 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:39.077349 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-ace9e6da-c84e-4236-bc56-64029602e5c5 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1523 microversion: 2.1 time: 0.171048 Sep 21 12:24:39.078127 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 238/470] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:38 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:39.335467 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-362a8e0e-f5f3-4971-a760-cd41565466d5 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:39.336120 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-362a8e0e-f5f3-4971-a760-cd41565466d5 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:39.345865 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-362a8e0e-f5f3-4971-a760-cd41565466d5 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:39.346373 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-362a8e0e-f5f3-4971-a760-cd41565466d5 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:39.346816 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-362a8e0e-f5f3-4971-a760-cd41565466d5 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:39.347563 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-362a8e0e-f5f3-4971-a760-cd41565466d5 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:39.348059 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-362a8e0e-f5f3-4971-a760-cd41565466d5 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:39.348491 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-362a8e0e-f5f3-4971-a760-cd41565466d5 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:39.500210 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-362a8e0e-f5f3-4971-a760-cd41565466d5 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:39.508049 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-362a8e0e-f5f3-4971-a760-cd41565466d5 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1358 microversion: 2.1 time: 0.177974 Sep 21 12:24:39.508624 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 233/471] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:39 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:40.101179 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-5084f70d-7dde-4c16-8f36-9fb8f718d540 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:40.101796 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-5084f70d-7dde-4c16-8f36-9fb8f718d540 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:40.104316 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell0:SELECT=2 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:40.111975 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5084f70d-7dde-4c16-8f36-9fb8f718d540 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:40.112499 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5084f70d-7dde-4c16-8f36-9fb8f718d540 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:40.115988 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5084f70d-7dde-4c16-8f36-9fb8f718d540 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:40.115988 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5084f70d-7dde-4c16-8f36-9fb8f718d540 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:40.115988 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5084f70d-7dde-4c16-8f36-9fb8f718d540 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:40.115988 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5084f70d-7dde-4c16-8f36-9fb8f718d540 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:40.380241 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-5084f70d-7dde-4c16-8f36-9fb8f718d540 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:40.387815 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-5084f70d-7dde-4c16-8f36-9fb8f718d540 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1523 microversion: 2.1 time: 0.290787 Sep 21 12:24:40.389610 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 239/472] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:40 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1523 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:40.531409 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-0d0cad11-20c9-4b73-a0f5-48ffacf4fec1 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:40.532125 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-0d0cad11-20c9-4b73-a0f5-48ffacf4fec1 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:40.534211 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell0:SELECT=2 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:40.535132 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell0:SELECT=10 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:40.541425 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0d0cad11-20c9-4b73-a0f5-48ffacf4fec1 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:40.542272 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0d0cad11-20c9-4b73-a0f5-48ffacf4fec1 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:40.543129 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0d0cad11-20c9-4b73-a0f5-48ffacf4fec1 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:40.544651 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0d0cad11-20c9-4b73-a0f5-48ffacf4fec1 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:40.545665 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0d0cad11-20c9-4b73-a0f5-48ffacf4fec1 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:40.546560 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0d0cad11-20c9-4b73-a0f5-48ffacf4fec1 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:40.716303 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-0d0cad11-20c9-4b73-a0f5-48ffacf4fec1 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:40.726061 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-0d0cad11-20c9-4b73-a0f5-48ffacf4fec1 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1358 microversion: 2.1 time: 0.198400 Sep 21 12:24:40.726801 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 234/473] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:40 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:41.280844 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-c0ead970-688e-4e4a-88b9-eeafd2ce8e12 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:24:41.282105 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-c0ead970-688e-4e4a-88b9-eeafd2ce8e12 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:41.292956 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0ead970-688e-4e4a-88b9-eeafd2ce8e12 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:41.293450 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0ead970-688e-4e4a-88b9-eeafd2ce8e12 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:41.294205 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0ead970-688e-4e4a-88b9-eeafd2ce8e12 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:41.295728 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0ead970-688e-4e4a-88b9-eeafd2ce8e12 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:41.296602 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0ead970-688e-4e4a-88b9-eeafd2ce8e12 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:41.297849 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0ead970-688e-4e4a-88b9-eeafd2ce8e12 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:41.328058 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.objects.instance [None req-c0ead970-688e-4e4a-88b9-eeafd2ce8e12 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lazy-loading 'flavor' on Instance uuid 5e9ebd08-4c95-43f6-a1a4-3268532d961e {{(pid=120463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 12:24:41.415452 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-f375c3c4-6c0c-43f1-a434-9d0c3f5cef53 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:41.416101 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-f375c3c4-6c0c-43f1-a434-9d0c3f5cef53 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:41.423055 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f375c3c4-6c0c-43f1-a434-9d0c3f5cef53 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:41.423785 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f375c3c4-6c0c-43f1-a434-9d0c3f5cef53 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:41.424230 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f375c3c4-6c0c-43f1-a434-9d0c3f5cef53 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:41.424921 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f375c3c4-6c0c-43f1-a434-9d0c3f5cef53 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:41.425546 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f375c3c4-6c0c-43f1-a434-9d0c3f5cef53 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:41.426399 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f375c3c4-6c0c-43f1-a434-9d0c3f5cef53 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:41.568859 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-c0ead970-688e-4e4a-88b9-eeafd2ce8e12 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "POST /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e/action" status: 202 len: 0 microversion: 2.20 time: 0.292010 Sep 21 12:24:41.569485 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 240/474] 10.222.0.71 () {62 vars in 1319 bytes} [Wed Sep 21 12:24:41 2022] POST /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 21 12:24:41.581578 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-176c897d-380b-402f-a130-7ec2868cfbca tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9717b74-cf62-4ca4-8419-e4805971dcab"}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:24:41.584300 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-176c897d-380b-402f-a130-7ec2868cfbca tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:41.594394 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-176c897d-380b-402f-a130-7ec2868cfbca tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:41.595167 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-176c897d-380b-402f-a130-7ec2868cfbca tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:41.595783 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-176c897d-380b-402f-a130-7ec2868cfbca tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:41.596656 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-176c897d-380b-402f-a130-7ec2868cfbca tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:41.597263 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-176c897d-380b-402f-a130-7ec2868cfbca tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:41.597841 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-176c897d-380b-402f-a130-7ec2868cfbca tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:41.601278 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-f375c3c4-6c0c-43f1-a434-9d0c3f5cef53 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:41.611638 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-f375c3c4-6c0c-43f1-a434-9d0c3f5cef53 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1523 microversion: 2.1 time: 0.200845 Sep 21 12:24:41.612757 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 235/475] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:41 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:24:41.617675 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-a05f6fc6-0f43-4eb3-96a7-8ec0272f5ab7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:41.618287 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-a05f6fc6-0f43-4eb3-96a7-8ec0272f5ab7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:41.625007 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a05f6fc6-0f43-4eb3-96a7-8ec0272f5ab7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:41.625499 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a05f6fc6-0f43-4eb3-96a7-8ec0272f5ab7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:41.626440 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a05f6fc6-0f43-4eb3-96a7-8ec0272f5ab7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:41.627437 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a05f6fc6-0f43-4eb3-96a7-8ec0272f5ab7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:41.627950 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a05f6fc6-0f43-4eb3-96a7-8ec0272f5ab7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:41.628385 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a05f6fc6-0f43-4eb3-96a7-8ec0272f5ab7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:41.778850 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-a05f6fc6-0f43-4eb3-96a7-8ec0272f5ab7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:41.787492 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-a05f6fc6-0f43-4eb3-96a7-8ec0272f5ab7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:41.788969 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-a05f6fc6-0f43-4eb3-96a7-8ec0272f5ab7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:41.790123 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-a05f6fc6-0f43-4eb3-96a7-8ec0272f5ab7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1725 microversion: 2.20 time: 0.176437 Sep 21 12:24:41.790674 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 236/476] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:24:41 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:24:41.796682 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-8ae58ebf-f9fa-4799-97fe-11c499568d49 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:41.797523 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-8ae58ebf-f9fa-4799-97fe-11c499568d49 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:41.804439 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8ae58ebf-f9fa-4799-97fe-11c499568d49 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:41.805156 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8ae58ebf-f9fa-4799-97fe-11c499568d49 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:41.805780 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8ae58ebf-f9fa-4799-97fe-11c499568d49 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:41.806656 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8ae58ebf-f9fa-4799-97fe-11c499568d49 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:41.807117 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8ae58ebf-f9fa-4799-97fe-11c499568d49 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:41.807545 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8ae58ebf-f9fa-4799-97fe-11c499568d49 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:41.943657 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-8ae58ebf-f9fa-4799-97fe-11c499568d49 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:41.953094 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-8ae58ebf-f9fa-4799-97fe-11c499568d49 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1358 microversion: 2.1 time: 0.161293 Sep 21 12:24:41.954239 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 237/477] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:41 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:42.639057 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-bc3ad236-9e13-4d6a-bb7c-470a71c51624 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:42.639962 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-bc3ad236-9e13-4d6a-bb7c-470a71c51624 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:42.646019 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bc3ad236-9e13-4d6a-bb7c-470a71c51624 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:42.646509 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bc3ad236-9e13-4d6a-bb7c-470a71c51624 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:42.646952 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bc3ad236-9e13-4d6a-bb7c-470a71c51624 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:42.647665 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bc3ad236-9e13-4d6a-bb7c-470a71c51624 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:42.648154 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bc3ad236-9e13-4d6a-bb7c-470a71c51624 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:42.648588 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bc3ad236-9e13-4d6a-bb7c-470a71c51624 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:42.798706 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-bc3ad236-9e13-4d6a-bb7c-470a71c51624 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:42.806667 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-bc3ad236-9e13-4d6a-bb7c-470a71c51624 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1523 microversion: 2.1 time: 0.171510 Sep 21 12:24:42.807248 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 238/478] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:42 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:24:42.815138 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-3036b728-3493-4f78-9bcb-a95647b83d59 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:42.816207 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-3036b728-3493-4f78-9bcb-a95647b83d59 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:42.824314 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3036b728-3493-4f78-9bcb-a95647b83d59 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:42.824810 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3036b728-3493-4f78-9bcb-a95647b83d59 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:42.825249 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3036b728-3493-4f78-9bcb-a95647b83d59 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:42.826058 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3036b728-3493-4f78-9bcb-a95647b83d59 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:42.826672 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3036b728-3493-4f78-9bcb-a95647b83d59 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:42.827158 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3036b728-3493-4f78-9bcb-a95647b83d59 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:42.969761 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-3036b728-3493-4f78-9bcb-a95647b83d59 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:42.978552 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-3036b728-3493-4f78-9bcb-a95647b83d59 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:42.980013 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-3036b728-3493-4f78-9bcb-a95647b83d59 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:42.981185 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-3036b728-3493-4f78-9bcb-a95647b83d59 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1725 microversion: 2.20 time: 0.169917 Sep 21 12:24:42.981744 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 239/479] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:24:42 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:24:42.986831 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-63c0aad9-3017-490f-8c97-4638389f3bc9 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:42.987420 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-63c0aad9-3017-490f-8c97-4638389f3bc9 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:42.993196 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-63c0aad9-3017-490f-8c97-4638389f3bc9 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:42.993726 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-63c0aad9-3017-490f-8c97-4638389f3bc9 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:42.994157 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-63c0aad9-3017-490f-8c97-4638389f3bc9 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:42.994833 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-63c0aad9-3017-490f-8c97-4638389f3bc9 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:42.995278 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-63c0aad9-3017-490f-8c97-4638389f3bc9 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:42.995698 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-63c0aad9-3017-490f-8c97-4638389f3bc9 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:43.150345 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-63c0aad9-3017-490f-8c97-4638389f3bc9 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:43.158914 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-63c0aad9-3017-490f-8c97-4638389f3bc9 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1358 microversion: 2.1 time: 0.175470 Sep 21 12:24:43.159488 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 240/480] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:42 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:43.830605 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-ec67dc3a-f0f0-4347-9d07-54d5267d7b01 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:43.831427 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-ec67dc3a-f0f0-4347-9d07-54d5267d7b01 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:43.837783 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ec67dc3a-f0f0-4347-9d07-54d5267d7b01 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:43.838386 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ec67dc3a-f0f0-4347-9d07-54d5267d7b01 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:43.838909 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ec67dc3a-f0f0-4347-9d07-54d5267d7b01 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:43.839624 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ec67dc3a-f0f0-4347-9d07-54d5267d7b01 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:43.840119 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ec67dc3a-f0f0-4347-9d07-54d5267d7b01 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:43.840559 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ec67dc3a-f0f0-4347-9d07-54d5267d7b01 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:43.973150 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-ec67dc3a-f0f0-4347-9d07-54d5267d7b01 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:43.981583 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-ec67dc3a-f0f0-4347-9d07-54d5267d7b01 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1523 microversion: 2.1 time: 0.155016 Sep 21 12:24:43.982846 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 241/481] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:43 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:44.007460 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-9576a9f5-7367-4ecb-a46a-16000edff652 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:44.008200 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-9576a9f5-7367-4ecb-a46a-16000edff652 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:44.014791 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9576a9f5-7367-4ecb-a46a-16000edff652 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:44.015283 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9576a9f5-7367-4ecb-a46a-16000edff652 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:44.015726 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9576a9f5-7367-4ecb-a46a-16000edff652 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:44.016470 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9576a9f5-7367-4ecb-a46a-16000edff652 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:44.016924 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9576a9f5-7367-4ecb-a46a-16000edff652 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:44.017351 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9576a9f5-7367-4ecb-a46a-16000edff652 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:44.151398 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-9576a9f5-7367-4ecb-a46a-16000edff652 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:44.160772 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-9576a9f5-7367-4ecb-a46a-16000edff652 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:44.162563 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-9576a9f5-7367-4ecb-a46a-16000edff652 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:44.163883 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-9576a9f5-7367-4ecb-a46a-16000edff652 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1725 microversion: 2.20 time: 0.160815 Sep 21 12:24:44.164644 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 242/482] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:24:44 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:24:44.187441 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-56786996-ebe4-467b-b646-fc2c0ca7fdd5 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:44.188170 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-56786996-ebe4-467b-b646-fc2c0ca7fdd5 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:44.194576 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-56786996-ebe4-467b-b646-fc2c0ca7fdd5 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:44.195069 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-56786996-ebe4-467b-b646-fc2c0ca7fdd5 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:44.195506 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-56786996-ebe4-467b-b646-fc2c0ca7fdd5 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:44.196249 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-56786996-ebe4-467b-b646-fc2c0ca7fdd5 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:44.196705 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-56786996-ebe4-467b-b646-fc2c0ca7fdd5 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:44.197139 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-56786996-ebe4-467b-b646-fc2c0ca7fdd5 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:44.345631 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-56786996-ebe4-467b-b646-fc2c0ca7fdd5 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:44.353622 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-56786996-ebe4-467b-b646-fc2c0ca7fdd5 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1358 microversion: 2.1 time: 0.172570 Sep 21 12:24:44.368438 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 243/483] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:44 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:45.005228 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-36f1e321-c2b0-456e-93c3-9d908c0d5b4d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:45.005902 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-36f1e321-c2b0-456e-93c3-9d908c0d5b4d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:45.011748 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-36f1e321-c2b0-456e-93c3-9d908c0d5b4d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:45.012263 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-36f1e321-c2b0-456e-93c3-9d908c0d5b4d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:45.012704 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-36f1e321-c2b0-456e-93c3-9d908c0d5b4d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:45.014060 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-36f1e321-c2b0-456e-93c3-9d908c0d5b4d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:45.014515 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-36f1e321-c2b0-456e-93c3-9d908c0d5b4d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:45.014949 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-36f1e321-c2b0-456e-93c3-9d908c0d5b4d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:45.144749 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-36f1e321-c2b0-456e-93c3-9d908c0d5b4d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:45.152362 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-36f1e321-c2b0-456e-93c3-9d908c0d5b4d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1523 microversion: 2.1 time: 0.151142 Sep 21 12:24:45.152923 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 244/484] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:45 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:24:45.194132 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-7afd61e6-cf1b-4708-a130-8174ddbdad1e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:45.194749 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-7afd61e6-cf1b-4708-a130-8174ddbdad1e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:45.201586 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7afd61e6-cf1b-4708-a130-8174ddbdad1e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:45.202071 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7afd61e6-cf1b-4708-a130-8174ddbdad1e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:45.202640 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7afd61e6-cf1b-4708-a130-8174ddbdad1e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:45.203343 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7afd61e6-cf1b-4708-a130-8174ddbdad1e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:45.203869 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7afd61e6-cf1b-4708-a130-8174ddbdad1e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:45.204548 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7afd61e6-cf1b-4708-a130-8174ddbdad1e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:45.345124 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-7afd61e6-cf1b-4708-a130-8174ddbdad1e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:45.353396 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-7afd61e6-cf1b-4708-a130-8174ddbdad1e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:45.354834 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-7afd61e6-cf1b-4708-a130-8174ddbdad1e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:45.356032 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-7afd61e6-cf1b-4708-a130-8174ddbdad1e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1725 microversion: 2.20 time: 0.165785 Sep 21 12:24:45.356641 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 245/485] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:24:45 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:24:45.378004 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-f6840986-1067-4290-b6ea-50e67aeb5680 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:45.378659 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-f6840986-1067-4290-b6ea-50e67aeb5680 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:45.384562 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f6840986-1067-4290-b6ea-50e67aeb5680 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:45.385042 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f6840986-1067-4290-b6ea-50e67aeb5680 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:45.385500 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f6840986-1067-4290-b6ea-50e67aeb5680 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:45.386179 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f6840986-1067-4290-b6ea-50e67aeb5680 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:45.386683 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f6840986-1067-4290-b6ea-50e67aeb5680 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:45.387163 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f6840986-1067-4290-b6ea-50e67aeb5680 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:45.530467 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-f6840986-1067-4290-b6ea-50e67aeb5680 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:45.538085 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-f6840986-1067-4290-b6ea-50e67aeb5680 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1358 microversion: 2.1 time: 0.163955 Sep 21 12:24:45.538589 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 246/486] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:45 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:24:46.174848 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-5dd0834d-fc03-4be3-b64c-f92b4504d8dd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:46.175590 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-5dd0834d-fc03-4be3-b64c-f92b4504d8dd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:46.181833 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5dd0834d-fc03-4be3-b64c-f92b4504d8dd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:46.182349 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5dd0834d-fc03-4be3-b64c-f92b4504d8dd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:46.182747 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5dd0834d-fc03-4be3-b64c-f92b4504d8dd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:46.183467 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5dd0834d-fc03-4be3-b64c-f92b4504d8dd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:46.183967 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5dd0834d-fc03-4be3-b64c-f92b4504d8dd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:46.184399 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5dd0834d-fc03-4be3-b64c-f92b4504d8dd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:46.330328 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-5dd0834d-fc03-4be3-b64c-f92b4504d8dd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:46.332587 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=100 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:46.339634 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-5dd0834d-fc03-4be3-b64c-f92b4504d8dd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1523 microversion: 2.1 time: 0.168744 Sep 21 12:24:46.340293 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 247/487] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:46 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:24:46.385396 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-e209c12e-3a3a-4a83-b874-7e9157fff243 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:46.386009 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-e209c12e-3a3a-4a83-b874-7e9157fff243 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:46.393533 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e209c12e-3a3a-4a83-b874-7e9157fff243 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:46.394014 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e209c12e-3a3a-4a83-b874-7e9157fff243 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:46.394448 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e209c12e-3a3a-4a83-b874-7e9157fff243 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:46.395144 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e209c12e-3a3a-4a83-b874-7e9157fff243 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:46.395592 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e209c12e-3a3a-4a83-b874-7e9157fff243 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:46.396045 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e209c12e-3a3a-4a83-b874-7e9157fff243 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:46.525142 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-e209c12e-3a3a-4a83-b874-7e9157fff243 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:46.533214 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-e209c12e-3a3a-4a83-b874-7e9157fff243 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:46.534673 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-e209c12e-3a3a-4a83-b874-7e9157fff243 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:46.535860 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-e209c12e-3a3a-4a83-b874-7e9157fff243 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1725 microversion: 2.20 time: 0.157027 Sep 21 12:24:46.536431 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 248/488] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:24:46 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:24:46.561417 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-2610a3ad-4315-4a77-b85f-34c905ee5025 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:46.562067 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-2610a3ad-4315-4a77-b85f-34c905ee5025 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:46.568338 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2610a3ad-4315-4a77-b85f-34c905ee5025 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:46.568833 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2610a3ad-4315-4a77-b85f-34c905ee5025 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:46.569273 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2610a3ad-4315-4a77-b85f-34c905ee5025 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:46.569982 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2610a3ad-4315-4a77-b85f-34c905ee5025 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:46.570441 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2610a3ad-4315-4a77-b85f-34c905ee5025 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:46.570871 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2610a3ad-4315-4a77-b85f-34c905ee5025 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:46.702971 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-2610a3ad-4315-4a77-b85f-34c905ee5025 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:46.711019 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-2610a3ad-4315-4a77-b85f-34c905ee5025 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1358 microversion: 2.1 time: 0.154137 Sep 21 12:24:46.711610 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 249/489] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:46 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:24:47.363133 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-295b440f-c008-4913-9c68-d66b61a4357f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:47.363837 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-295b440f-c008-4913-9c68-d66b61a4357f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:47.369720 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-295b440f-c008-4913-9c68-d66b61a4357f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:47.370208 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-295b440f-c008-4913-9c68-d66b61a4357f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:47.370649 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-295b440f-c008-4913-9c68-d66b61a4357f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:47.371344 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-295b440f-c008-4913-9c68-d66b61a4357f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:47.371826 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-295b440f-c008-4913-9c68-d66b61a4357f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:47.372262 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-295b440f-c008-4913-9c68-d66b61a4357f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:47.502336 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-295b440f-c008-4913-9c68-d66b61a4357f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:47.510191 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-295b440f-c008-4913-9c68-d66b61a4357f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1523 microversion: 2.1 time: 0.150962 Sep 21 12:24:47.510767 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 250/490] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:47 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:24:47.560469 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-daf4601d-cd29-4ea6-9e8a-91cb1dcd65e3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:47.561081 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-daf4601d-cd29-4ea6-9e8a-91cb1dcd65e3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:47.567055 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-daf4601d-cd29-4ea6-9e8a-91cb1dcd65e3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:47.567545 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-daf4601d-cd29-4ea6-9e8a-91cb1dcd65e3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:47.568031 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-daf4601d-cd29-4ea6-9e8a-91cb1dcd65e3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:47.568741 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-daf4601d-cd29-4ea6-9e8a-91cb1dcd65e3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:47.569203 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-daf4601d-cd29-4ea6-9e8a-91cb1dcd65e3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:47.569631 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-daf4601d-cd29-4ea6-9e8a-91cb1dcd65e3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:47.700286 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-daf4601d-cd29-4ea6-9e8a-91cb1dcd65e3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:47.709282 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-daf4601d-cd29-4ea6-9e8a-91cb1dcd65e3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:47.710756 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-daf4601d-cd29-4ea6-9e8a-91cb1dcd65e3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:47.711973 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-daf4601d-cd29-4ea6-9e8a-91cb1dcd65e3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1725 microversion: 2.20 time: 0.155361 Sep 21 12:24:47.712538 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 251/491] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:24:47 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:24:47.732276 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-b19456ae-ab1f-4f93-b479-fd4da3430bf7 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:47.732891 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-b19456ae-ab1f-4f93-b479-fd4da3430bf7 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:47.738898 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b19456ae-ab1f-4f93-b479-fd4da3430bf7 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:47.739386 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b19456ae-ab1f-4f93-b479-fd4da3430bf7 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:47.739853 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b19456ae-ab1f-4f93-b479-fd4da3430bf7 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:47.740551 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b19456ae-ab1f-4f93-b479-fd4da3430bf7 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:47.741010 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b19456ae-ab1f-4f93-b479-fd4da3430bf7 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:47.741443 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b19456ae-ab1f-4f93-b479-fd4da3430bf7 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:47.876429 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-b19456ae-ab1f-4f93-b479-fd4da3430bf7 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:47.884123 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-b19456ae-ab1f-4f93-b479-fd4da3430bf7 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1358 microversion: 2.1 time: 0.155430 Sep 21 12:24:47.884700 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 252/492] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:47 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:24:48.533696 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-70e8b783-63a5-4bab-83cf-7cc13c8f7116 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:48.534459 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-70e8b783-63a5-4bab-83cf-7cc13c8f7116 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:48.540639 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-70e8b783-63a5-4bab-83cf-7cc13c8f7116 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:48.541203 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-70e8b783-63a5-4bab-83cf-7cc13c8f7116 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:48.541710 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-70e8b783-63a5-4bab-83cf-7cc13c8f7116 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:48.542480 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-70e8b783-63a5-4bab-83cf-7cc13c8f7116 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:48.543017 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-70e8b783-63a5-4bab-83cf-7cc13c8f7116 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:48.543510 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-70e8b783-63a5-4bab-83cf-7cc13c8f7116 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:48.771351 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-70e8b783-63a5-4bab-83cf-7cc13c8f7116 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:48.782676 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-70e8b783-63a5-4bab-83cf-7cc13c8f7116 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1523 microversion: 2.1 time: 0.252530 Sep 21 12:24:48.783267 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 253/493] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:48 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1523 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:24:48.788885 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-f66e344d-67d1-4c3d-84d9-44c001f1ca80 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:48.790052 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-f66e344d-67d1-4c3d-84d9-44c001f1ca80 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:48.797378 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f66e344d-67d1-4c3d-84d9-44c001f1ca80 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:48.798221 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f66e344d-67d1-4c3d-84d9-44c001f1ca80 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:48.798870 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f66e344d-67d1-4c3d-84d9-44c001f1ca80 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:48.799819 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f66e344d-67d1-4c3d-84d9-44c001f1ca80 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:48.800502 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f66e344d-67d1-4c3d-84d9-44c001f1ca80 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:48.801150 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f66e344d-67d1-4c3d-84d9-44c001f1ca80 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:48.884051 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-176c897d-380b-402f-a130-7ec2868cfbca tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "POST /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.307335 Sep 21 12:24:48.885825 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 241/494] 10.222.0.71 () {60 vars in 1323 bytes} [Wed Sep 21 12:24:41 2022] POST /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e/os-volume_attachments => generated 194 bytes in 7311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:24:48.913711 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-aafbfa50-c9c2-48fc-9e67-202f846ab280 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:48.914790 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-aafbfa50-c9c2-48fc-9e67-202f846ab280 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:48.923460 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-aafbfa50-c9c2-48fc-9e67-202f846ab280 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:48.924479 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-aafbfa50-c9c2-48fc-9e67-202f846ab280 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:48.925180 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-aafbfa50-c9c2-48fc-9e67-202f846ab280 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:48.925909 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-aafbfa50-c9c2-48fc-9e67-202f846ab280 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:48.926455 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-aafbfa50-c9c2-48fc-9e67-202f846ab280 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:48.926813 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-aafbfa50-c9c2-48fc-9e67-202f846ab280 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:49.050382 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-f66e344d-67d1-4c3d-84d9-44c001f1ca80 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:49.059412 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-f66e344d-67d1-4c3d-84d9-44c001f1ca80 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:49.061087 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-f66e344d-67d1-4c3d-84d9-44c001f1ca80 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:49.062228 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-f66e344d-67d1-4c3d-84d9-44c001f1ca80 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1725 microversion: 2.20 time: 0.277761 Sep 21 12:24:49.062799 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 254/495] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:24:48 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1725 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:24:49.073280 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-aafbfa50-c9c2-48fc-9e67-202f846ab280 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:49.082602 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-aafbfa50-c9c2-48fc-9e67-202f846ab280 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1358 microversion: 2.1 time: 0.179313 Sep 21 12:24:49.083208 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 242/496] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:48 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:49.496661 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-9237a359-c0c8-40f5-92cd-7648a06d8912 req-82feb22e-09f2-4a60-8a52-7e5a13d02a4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cc8e107-efaf-4689-9e8f-f8adc955c6d9", "tag": "2d86ac1e-8e22-4863-a099-2f5b0b120e07"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:24:49.506650 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-9237a359-c0c8-40f5-92cd-7648a06d8912 req-82feb22e-09f2-4a60-8a52-7e5a13d02a4d service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:49.507137 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-9237a359-c0c8-40f5-92cd-7648a06d8912 req-82feb22e-09f2-4a60-8a52-7e5a13d02a4d service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:49.507575 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-9237a359-c0c8-40f5-92cd-7648a06d8912 req-82feb22e-09f2-4a60-8a52-7e5a13d02a4d service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:49.519219 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-9237a359-c0c8-40f5-92cd-7648a06d8912 req-82feb22e-09f2-4a60-8a52-7e5a13d02a4d service nova] Creating event network-changed:2d86ac1e-8e22-4863-a099-2f5b0b120e07 for instance 3cc8e107-efaf-4689-9e8f-f8adc955c6d9 on hv-cinder-85867 Sep 21 12:24:49.524230 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-9237a359-c0c8-40f5-92cd-7648a06d8912 req-82feb22e-09f2-4a60-8a52-7e5a13d02a4d service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031212 Sep 21 12:24:49.524831 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 255/497] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 12:24:49.810880 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-91108e97-a4f5-4a92-9bd9-8c48c959d522 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:49.811502 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-91108e97-a4f5-4a92-9bd9-8c48c959d522 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:49.818064 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-91108e97-a4f5-4a92-9bd9-8c48c959d522 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:49.818547 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-91108e97-a4f5-4a92-9bd9-8c48c959d522 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:49.818988 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-91108e97-a4f5-4a92-9bd9-8c48c959d522 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:49.819686 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-91108e97-a4f5-4a92-9bd9-8c48c959d522 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:49.820175 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-91108e97-a4f5-4a92-9bd9-8c48c959d522 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:49.820609 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-91108e97-a4f5-4a92-9bd9-8c48c959d522 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:49.947707 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-91108e97-a4f5-4a92-9bd9-8c48c959d522 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:49.955620 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-91108e97-a4f5-4a92-9bd9-8c48c959d522 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1523 microversion: 2.1 time: 0.149260 Sep 21 12:24:49.956216 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 243/498] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:49 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:50.088898 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-f577ac82-bc14-4b77-b31d-2cddf80755a4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:50.089733 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-f577ac82-bc14-4b77-b31d-2cddf80755a4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:50.097337 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f577ac82-bc14-4b77-b31d-2cddf80755a4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:50.097844 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f577ac82-bc14-4b77-b31d-2cddf80755a4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:50.098266 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f577ac82-bc14-4b77-b31d-2cddf80755a4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:50.098997 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f577ac82-bc14-4b77-b31d-2cddf80755a4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:50.099451 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f577ac82-bc14-4b77-b31d-2cddf80755a4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:50.099918 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f577ac82-bc14-4b77-b31d-2cddf80755a4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:50.106432 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-8744f926-43cc-487f-900e-6b0856bf764a tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:50.107114 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-8744f926-43cc-487f-900e-6b0856bf764a tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:50.114219 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8744f926-43cc-487f-900e-6b0856bf764a tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:50.114707 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8744f926-43cc-487f-900e-6b0856bf764a tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:50.115181 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8744f926-43cc-487f-900e-6b0856bf764a tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:50.115922 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8744f926-43cc-487f-900e-6b0856bf764a tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:50.116382 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8744f926-43cc-487f-900e-6b0856bf764a tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:50.116812 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8744f926-43cc-487f-900e-6b0856bf764a tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:50.229770 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-f577ac82-bc14-4b77-b31d-2cddf80755a4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:50.239804 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-f577ac82-bc14-4b77-b31d-2cddf80755a4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:50.241308 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-f577ac82-bc14-4b77-b31d-2cddf80755a4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:50.242476 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-f577ac82-bc14-4b77-b31d-2cddf80755a4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1725 microversion: 2.20 time: 0.158048 Sep 21 12:24:50.243027 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 256/499] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:24:50 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:24:50.243319 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-8744f926-43cc-487f-900e-6b0856bf764a tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:50.252755 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-8744f926-43cc-487f-900e-6b0856bf764a tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1358 microversion: 2.1 time: 0.150131 Sep 21 12:24:50.253418 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 244/500] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:50 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:24:50.978684 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-51030ef9-9fc3-4087-94ed-db07f4a7a168 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:50.978927 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-51030ef9-9fc3-4087-94ed-db07f4a7a168 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:50.985077 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-51030ef9-9fc3-4087-94ed-db07f4a7a168 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:50.985566 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-51030ef9-9fc3-4087-94ed-db07f4a7a168 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:50.985998 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-51030ef9-9fc3-4087-94ed-db07f4a7a168 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:50.986695 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-51030ef9-9fc3-4087-94ed-db07f4a7a168 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:50.987142 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-51030ef9-9fc3-4087-94ed-db07f4a7a168 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:50.988090 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-51030ef9-9fc3-4087-94ed-db07f4a7a168 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:51.268497 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-51030ef9-9fc3-4087-94ed-db07f4a7a168 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:51.270791 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-6f696323-bea9-4935-b2ca-cc42d942c763 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:51.271242 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-6f696323-bea9-4935-b2ca-cc42d942c763 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:51.276274 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-51030ef9-9fc3-4087-94ed-db07f4a7a168 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1523 microversion: 2.1 time: 0.301782 Sep 21 12:24:51.276851 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 257/501] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:50 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1523 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:51.277848 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6f696323-bea9-4935-b2ca-cc42d942c763 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:51.278537 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6f696323-bea9-4935-b2ca-cc42d942c763 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:51.279150 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6f696323-bea9-4935-b2ca-cc42d942c763 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:51.280041 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6f696323-bea9-4935-b2ca-cc42d942c763 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:51.280659 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6f696323-bea9-4935-b2ca-cc42d942c763 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:51.281245 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6f696323-bea9-4935-b2ca-cc42d942c763 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:51.281359 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-bd96d40f-b7a3-45a0-8de6-a55c4f096502 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:51.281930 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-bd96d40f-b7a3-45a0-8de6-a55c4f096502 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:51.288415 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bd96d40f-b7a3-45a0-8de6-a55c4f096502 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:51.288905 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bd96d40f-b7a3-45a0-8de6-a55c4f096502 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:51.289341 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bd96d40f-b7a3-45a0-8de6-a55c4f096502 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:51.290212 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bd96d40f-b7a3-45a0-8de6-a55c4f096502 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:51.290669 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bd96d40f-b7a3-45a0-8de6-a55c4f096502 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:51.291150 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bd96d40f-b7a3-45a0-8de6-a55c4f096502 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:51.415134 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-6f696323-bea9-4935-b2ca-cc42d942c763 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:51.419379 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-bd96d40f-b7a3-45a0-8de6-a55c4f096502 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:51.424091 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-6f696323-bea9-4935-b2ca-cc42d942c763 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:51.425552 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-6f696323-bea9-4935-b2ca-cc42d942c763 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:51.426724 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-6f696323-bea9-4935-b2ca-cc42d942c763 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1725 microversion: 2.20 time: 0.160027 Sep 21 12:24:51.427308 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 245/502] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:24:51 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:24:51.427535 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-bd96d40f-b7a3-45a0-8de6-a55c4f096502 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1358 microversion: 2.1 time: 0.149603 Sep 21 12:24:51.427965 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 258/503] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:51 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:52.301903 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-478e6f88-df08-4ba9-ac43-2e94c1acf755 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:52.302538 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-478e6f88-df08-4ba9-ac43-2e94c1acf755 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:52.309173 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-478e6f88-df08-4ba9-ac43-2e94c1acf755 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:52.309665 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-478e6f88-df08-4ba9-ac43-2e94c1acf755 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:52.310107 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-478e6f88-df08-4ba9-ac43-2e94c1acf755 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:52.310810 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-478e6f88-df08-4ba9-ac43-2e94c1acf755 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:52.311271 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-478e6f88-df08-4ba9-ac43-2e94c1acf755 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:52.311699 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-478e6f88-df08-4ba9-ac43-2e94c1acf755 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:52.442889 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-478e6f88-df08-4ba9-ac43-2e94c1acf755 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:52.450322 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-5d6b0b30-a285-499d-8115-159baec81dd4 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:52.451088 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-5d6b0b30-a285-499d-8115-159baec81dd4 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:52.452533 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-478e6f88-df08-4ba9-ac43-2e94c1acf755 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1523 microversion: 2.1 time: 0.153782 Sep 21 12:24:52.453117 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 246/504] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:52 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:52.457873 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:52.458746 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-0188bdf9-91aa-4237-a43b-c7fb19df93be tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:52.459526 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-0188bdf9-91aa-4237-a43b-c7fb19df93be tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:52.460201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5d6b0b30-a285-499d-8115-159baec81dd4 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:52.461049 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5d6b0b30-a285-499d-8115-159baec81dd4 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:52.461585 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5d6b0b30-a285-499d-8115-159baec81dd4 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:52.462548 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5d6b0b30-a285-499d-8115-159baec81dd4 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:52.463227 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5d6b0b30-a285-499d-8115-159baec81dd4 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:52.464184 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5d6b0b30-a285-499d-8115-159baec81dd4 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:52.466653 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0188bdf9-91aa-4237-a43b-c7fb19df93be tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:52.467562 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0188bdf9-91aa-4237-a43b-c7fb19df93be tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:52.468314 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0188bdf9-91aa-4237-a43b-c7fb19df93be tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:52.469184 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0188bdf9-91aa-4237-a43b-c7fb19df93be tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:52.469781 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0188bdf9-91aa-4237-a43b-c7fb19df93be tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:52.470364 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0188bdf9-91aa-4237-a43b-c7fb19df93be tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:52.606775 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-0188bdf9-91aa-4237-a43b-c7fb19df93be tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:52.615205 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-0188bdf9-91aa-4237-a43b-c7fb19df93be tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:52.616813 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-0188bdf9-91aa-4237-a43b-c7fb19df93be tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:52.617996 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-0188bdf9-91aa-4237-a43b-c7fb19df93be tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1725 microversion: 2.20 time: 0.163514 Sep 21 12:24:52.618564 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 247/505] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:24:52 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:24:52.642654 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-5d6b0b30-a285-499d-8115-159baec81dd4 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:52.650313 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-5d6b0b30-a285-499d-8115-159baec81dd4 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1358 microversion: 2.1 time: 0.203906 Sep 21 12:24:52.650887 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 259/506] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:52 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:53.481279 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-fc2cedc1-1233-4385-ab15-a97828220dfb tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:53.483119 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-fc2cedc1-1233-4385-ab15-a97828220dfb tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:53.485797 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=48 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:53.492852 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fc2cedc1-1233-4385-ab15-a97828220dfb tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:53.493350 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fc2cedc1-1233-4385-ab15-a97828220dfb tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:53.493793 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fc2cedc1-1233-4385-ab15-a97828220dfb tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:53.494505 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fc2cedc1-1233-4385-ab15-a97828220dfb tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:53.494963 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fc2cedc1-1233-4385-ab15-a97828220dfb tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:53.495459 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fc2cedc1-1233-4385-ab15-a97828220dfb tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:53.625634 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-fc2cedc1-1233-4385-ab15-a97828220dfb tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:53.633492 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-fc2cedc1-1233-4385-ab15-a97828220dfb tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1503 microversion: 2.1 time: 0.156619 Sep 21 12:24:53.634065 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 248/507] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:53 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:53.644405 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-31f42e56-3a8a-4d22-8ee7-95823651a385 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:53.645051 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-31f42e56-3a8a-4d22-8ee7-95823651a385 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:53.651347 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-31f42e56-3a8a-4d22-8ee7-95823651a385 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:53.651870 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-31f42e56-3a8a-4d22-8ee7-95823651a385 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:53.652320 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-31f42e56-3a8a-4d22-8ee7-95823651a385 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:53.653024 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-31f42e56-3a8a-4d22-8ee7-95823651a385 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:53.653481 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-31f42e56-3a8a-4d22-8ee7-95823651a385 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:53.653911 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-31f42e56-3a8a-4d22-8ee7-95823651a385 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:53.656924 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-0c9b7685-d9ab-43f3-9c1c-b4c507ccc9c2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7574f95-e6a9-417a-beac-f2be77a19d75"}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:24:53.659309 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-0c9b7685-d9ab-43f3-9c1c-b4c507ccc9c2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:53.665434 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0c9b7685-d9ab-43f3-9c1c-b4c507ccc9c2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:53.665923 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0c9b7685-d9ab-43f3-9c1c-b4c507ccc9c2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:53.666367 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0c9b7685-d9ab-43f3-9c1c-b4c507ccc9c2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:53.667341 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0c9b7685-d9ab-43f3-9c1c-b4c507ccc9c2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:53.667618 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0c9b7685-d9ab-43f3-9c1c-b4c507ccc9c2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:53.668218 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0c9b7685-d9ab-43f3-9c1c-b4c507ccc9c2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:53.691733 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.wsgi [None req-0c9b7685-d9ab-43f3-9c1c-b4c507ccc9c2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] HTTP exception thrown: Cannot 'attach_volume' instance 5560ddde-2668-4e31-bbbf-b94d7485df5a while it is in vm_state rescued Sep 21 12:24:53.693399 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-0c9b7685-d9ab-43f3-9c1c-b4c507ccc9c2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Request method failure captured: Sep 21 12:24:53.693399 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: request: POST /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a/os-volume_attachments HTTP/1.1 Sep 21 12:24:53.693399 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept: application/json Sep 21 12:24:53.693399 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept-Encoding: identity Sep 21 12:24:53.693399 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Connection: close Sep 21 12:24:53.693399 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Length: 74 Sep 21 12:24:53.693399 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Type: application/json Sep 21 12:24:53.693399 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Host: 10.222.0.71 Sep 21 12:24:53.693399 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Openstack-System-Scope: None Sep 21 12:24:53.693399 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: User-Agent: python-urllib3/1.26.12 Sep 21 12:24:53.693399 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Auth-Token: gAAAAABjKwIu3mnwMp4ApNIfIkJUKxsVNJlj-i9y2ZniVDXL-EUHk78SFz38tXU5y8GhQ-eemD725G2hynLgc-_b-6YI8t1ZBLfru0cqJKYCMo5RetnJGUB4BU8XXayroqGJwhgW8Hog1xUJ-Zgaw42z7TLv76VdJCVDouWswH2FyTkqoFyyieY Sep 21 12:24:53.693399 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Id: None Sep 21 12:24:53.693399 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Name: None Sep 21 12:24:53.693399 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Identity-Status: Confirmed Sep 21 12:24:53.693399 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Is-Admin-Project: True Sep 21 12:24:53.693399 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Id: default Sep 21 12:24:53.693399 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Name: Default Sep 21 12:24:53.693399 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Id: d3bd02ae79fd4edb9886b1b4ef3d761a Sep 21 12:24:53.693399 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-914007599 Sep 21 12:24:53.693399 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Role: reader,member Sep 21 12:24:53.693399 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Roles: reader,member Sep 21 12:24:53.694895 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/d3bd02ae79fd4edb9886b1b4ef3d761a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/d3bd02ae79fd4edb9886b1b4ef3d761a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_d3bd02ae79fd4edb9886b1b4ef3d761a", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/d3bd02ae79fd4edb9886b1b4ef3d761a"}]}] Sep 21 12:24:53.694895 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant: tempest-ServerRescueNegativeTestJSON-914007599 Sep 21 12:24:53.694895 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Id: d3bd02ae79fd4edb9886b1b4ef3d761a Sep 21 12:24:53.694895 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-914007599 Sep 21 12:24:53.694895 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User: tempest-ServerRescueNegativeTestJSON-914007599-project Sep 21 12:24:53.694895 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Id: default Sep 21 12:24:53.694895 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Name: Default Sep 21 12:24:53.694895 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Id: 0fb9105e474a4a29904722b1e33d0155 Sep 21 12:24:53.694895 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Name: tempest-ServerRescueNegativeTestJSON-914007599-project Sep 21 12:24:53.694895 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Sep 21 12:24:53.694895 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: {"volumeAttachment": {"volumeId": "e7574f95-e6a9-417a-beac-f2be77a19d75"}} Sep 21 12:24:53.694895 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: method: > Sep 21 12:24:53.695872 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: exception: Cannot 'attach_volume' instance 5560ddde-2668-4e31-bbbf-b94d7485df5a while it is in vm_state rescued Sep 21 12:24:53.695872 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: action_args: {'server_id': '5560ddde-2668-4e31-bbbf-b94d7485df5a', 'body': {'volumeAttachment': {'volumeId': 'e7574f95-e6a9-417a-beac-f2be77a19d75'}}} Sep 21 12:24:53.695872 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:24:53.695872 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:24:53.695872 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 21 12:24:53.695872 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 21 12:24:53.695872 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 21 12:24:53.695872 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 21 12:24:53.695872 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 21 12:24:53.695872 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 21 12:24:53.695872 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5560ddde-2668-4e31-bbbf-b94d7485df5a in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 21 12:24:53.695872 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:24:53.695872 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:24:53.695872 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:24:53.695872 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:24:53.695872 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:24:53.695872 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:24:53.695872 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:24:53.695872 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:24:53.697210 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:24:53.697210 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:24:53.697210 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 21 12:24:53.697210 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 21 12:24:53.697210 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 21 12:24:53.697210 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 21 12:24:53.697210 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 21 12:24:53.697210 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 21 12:24:53.697210 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 21 12:24:53.697210 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 21 12:24:53.697210 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 21 12:24:53.697210 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 21 12:24:53.697210 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 5560ddde-2668-4e31-bbbf-b94d7485df5a while it is in vm_state rescued Sep 21 12:24:53.697210 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:24:53.697210 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:24:53.697210 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:24:53.697210 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:24:53.697210 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:24:53.697210 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:24:53.699057 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:24:53.699057 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:24:53.699057 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 5560ddde-2668-4e31-bbbf-b94d7485df5a while it is in vm_state rescued Sep 21 12:24:53.699057 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:24:53.699057 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-0c9b7685-d9ab-43f3-9c1c-b4c507ccc9c2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Returning 409 to user: Cannot 'attach_volume' instance 5560ddde-2668-4e31-bbbf-b94d7485df5a while it is in vm_state rescued {{(pid=120463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:24:53.699057 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-0c9b7685-d9ab-43f3-9c1c-b4c507ccc9c2 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "POST /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042739 Sep 21 12:24:53.699057 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 249/508] 10.222.0.71 () {60 vars in 1323 bytes} [Wed Sep 21 12:24:53 2022] POST /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 21 12:24:53.702886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-6d2d2d51-f0ba-4e3b-ad70-51672c349056 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:53.703503 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-6d2d2d51-f0ba-4e3b-ad70-51672c349056 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:53.709674 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6d2d2d51-f0ba-4e3b-ad70-51672c349056 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:53.710163 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6d2d2d51-f0ba-4e3b-ad70-51672c349056 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:53.710606 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6d2d2d51-f0ba-4e3b-ad70-51672c349056 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:53.711298 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6d2d2d51-f0ba-4e3b-ad70-51672c349056 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:53.711787 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6d2d2d51-f0ba-4e3b-ad70-51672c349056 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:53.712200 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6d2d2d51-f0ba-4e3b-ad70-51672c349056 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:53.794441 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-31f42e56-3a8a-4d22-8ee7-95823651a385 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:53.805709 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-31f42e56-3a8a-4d22-8ee7-95823651a385 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:53.807147 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-31f42e56-3a8a-4d22-8ee7-95823651a385 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:53.808348 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-31f42e56-3a8a-4d22-8ee7-95823651a385 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1725 microversion: 2.20 time: 0.167889 Sep 21 12:24:53.809356 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 260/509] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:24:53 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:24:53.813554 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-24193d3a-264e-47fd-9427-02a2c8626680 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:24:53.814079 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-24193d3a-264e-47fd-9427-02a2c8626680 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:53.819898 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-24193d3a-264e-47fd-9427-02a2c8626680 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:53.820383 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-24193d3a-264e-47fd-9427-02a2c8626680 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:53.820814 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-24193d3a-264e-47fd-9427-02a2c8626680 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:53.821501 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-24193d3a-264e-47fd-9427-02a2c8626680 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:53.821962 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-24193d3a-264e-47fd-9427-02a2c8626680 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:53.822694 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-24193d3a-264e-47fd-9427-02a2c8626680 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:53.843177 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-6d2d2d51-f0ba-4e3b-ad70-51672c349056 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:53.846570 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:53.851747 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-6d2d2d51-f0ba-4e3b-ad70-51672c349056 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1358 microversion: 2.1 time: 0.154847 Sep 21 12:24:53.852417 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 250/510] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:53 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:53.892179 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-24193d3a-264e-47fd-9427-02a2c8626680 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "POST /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a/action" status: 202 len: 0 microversion: 2.1 time: 0.081981 Sep 21 12:24:53.892809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 261/511] 10.222.0.71 () {60 vars in 1278 bytes} [Wed Sep 21 12:24:53 2022] POST /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 12:24:53.901209 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-340715d1-bc38-48e6-b6bc-5e9a4599e280 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:53.901831 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-340715d1-bc38-48e6-b6bc-5e9a4599e280 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:53.908688 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-340715d1-bc38-48e6-b6bc-5e9a4599e280 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:53.909183 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-340715d1-bc38-48e6-b6bc-5e9a4599e280 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:53.909630 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-340715d1-bc38-48e6-b6bc-5e9a4599e280 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:53.910327 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-340715d1-bc38-48e6-b6bc-5e9a4599e280 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:53.910789 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-340715d1-bc38-48e6-b6bc-5e9a4599e280 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:53.911220 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-340715d1-bc38-48e6-b6bc-5e9a4599e280 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:54.040830 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-340715d1-bc38-48e6-b6bc-5e9a4599e280 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:54.048614 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-340715d1-bc38-48e6-b6bc-5e9a4599e280 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1511 microversion: 2.1 time: 0.151515 Sep 21 12:24:54.049182 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 251/512] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:53 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:54.833708 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-93b180bc-75a5-4cdc-979f-304645a9d14c tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:54.834413 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-93b180bc-75a5-4cdc-979f-304645a9d14c tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:54.840903 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-93b180bc-75a5-4cdc-979f-304645a9d14c tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:54.841391 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-93b180bc-75a5-4cdc-979f-304645a9d14c tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:54.841828 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-93b180bc-75a5-4cdc-979f-304645a9d14c tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:54.843021 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-93b180bc-75a5-4cdc-979f-304645a9d14c tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:54.843479 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-93b180bc-75a5-4cdc-979f-304645a9d14c tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:54.843948 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-93b180bc-75a5-4cdc-979f-304645a9d14c tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:54.874490 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-2e5d9562-87b7-46a0-bb67-0b8e7233fb27 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:54.875112 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-2e5d9562-87b7-46a0-bb67-0b8e7233fb27 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:54.882099 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2e5d9562-87b7-46a0-bb67-0b8e7233fb27 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:54.882592 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2e5d9562-87b7-46a0-bb67-0b8e7233fb27 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:54.883036 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2e5d9562-87b7-46a0-bb67-0b8e7233fb27 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:54.884148 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2e5d9562-87b7-46a0-bb67-0b8e7233fb27 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:54.884264 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2e5d9562-87b7-46a0-bb67-0b8e7233fb27 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:54.884646 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2e5d9562-87b7-46a0-bb67-0b8e7233fb27 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:54.973470 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-93b180bc-75a5-4cdc-979f-304645a9d14c tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:54.982292 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-93b180bc-75a5-4cdc-979f-304645a9d14c tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:54.983821 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-93b180bc-75a5-4cdc-979f-304645a9d14c tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:54.984999 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-93b180bc-75a5-4cdc-979f-304645a9d14c tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1725 microversion: 2.20 time: 0.155966 Sep 21 12:24:54.985563 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 262/513] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:24:54 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:24:55.012268 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-2e5d9562-87b7-46a0-bb67-0b8e7233fb27 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:55.020301 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-2e5d9562-87b7-46a0-bb67-0b8e7233fb27 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1358 microversion: 2.1 time: 0.149685 Sep 21 12:24:55.020806 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 252/514] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:54 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:24:55.072117 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-d2e0494a-6de5-47de-a17f-18271f74f653 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:55.072733 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-d2e0494a-6de5-47de-a17f-18271f74f653 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:55.079541 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d2e0494a-6de5-47de-a17f-18271f74f653 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:55.080063 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d2e0494a-6de5-47de-a17f-18271f74f653 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:55.080507 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d2e0494a-6de5-47de-a17f-18271f74f653 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:55.081205 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d2e0494a-6de5-47de-a17f-18271f74f653 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:55.081661 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d2e0494a-6de5-47de-a17f-18271f74f653 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:55.082089 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d2e0494a-6de5-47de-a17f-18271f74f653 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:55.210933 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-d2e0494a-6de5-47de-a17f-18271f74f653 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:55.219587 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-d2e0494a-6de5-47de-a17f-18271f74f653 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1511 microversion: 2.1 time: 0.151529 Sep 21 12:24:55.220208 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 263/515] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:55 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:56.009316 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-5bfd6bf3-c0dc-405d-a709-fdb8404da1f3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:56.009943 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-5bfd6bf3-c0dc-405d-a709-fdb8404da1f3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:56.017132 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5bfd6bf3-c0dc-405d-a709-fdb8404da1f3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:56.017626 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5bfd6bf3-c0dc-405d-a709-fdb8404da1f3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:56.018072 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5bfd6bf3-c0dc-405d-a709-fdb8404da1f3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:56.018771 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5bfd6bf3-c0dc-405d-a709-fdb8404da1f3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:56.019232 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5bfd6bf3-c0dc-405d-a709-fdb8404da1f3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:56.019666 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5bfd6bf3-c0dc-405d-a709-fdb8404da1f3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:56.042392 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-91f8d184-ada4-4c8d-8e7f-28bbb556d097 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:56.043032 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-91f8d184-ada4-4c8d-8e7f-28bbb556d097 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:56.049185 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-91f8d184-ada4-4c8d-8e7f-28bbb556d097 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:56.049671 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-91f8d184-ada4-4c8d-8e7f-28bbb556d097 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:56.050109 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-91f8d184-ada4-4c8d-8e7f-28bbb556d097 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:56.050805 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-91f8d184-ada4-4c8d-8e7f-28bbb556d097 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:56.051257 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-91f8d184-ada4-4c8d-8e7f-28bbb556d097 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:56.051684 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-91f8d184-ada4-4c8d-8e7f-28bbb556d097 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:56.054403 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:56.154587 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-5bfd6bf3-c0dc-405d-a709-fdb8404da1f3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:56.163027 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-5bfd6bf3-c0dc-405d-a709-fdb8404da1f3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:56.164514 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-5bfd6bf3-c0dc-405d-a709-fdb8404da1f3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:56.165721 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-5bfd6bf3-c0dc-405d-a709-fdb8404da1f3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1725 microversion: 2.20 time: 0.160361 Sep 21 12:24:56.166282 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 253/516] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:24:56 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:24:56.242823 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-1e6ca1b3-09d3-4e73-a5ac-39d19eee29ea tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:56.243399 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-1e6ca1b3-09d3-4e73-a5ac-39d19eee29ea tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:56.250149 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1e6ca1b3-09d3-4e73-a5ac-39d19eee29ea tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:56.250461 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1e6ca1b3-09d3-4e73-a5ac-39d19eee29ea tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:56.250903 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1e6ca1b3-09d3-4e73-a5ac-39d19eee29ea tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:56.251608 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1e6ca1b3-09d3-4e73-a5ac-39d19eee29ea tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:56.252122 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1e6ca1b3-09d3-4e73-a5ac-39d19eee29ea tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:56.252565 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1e6ca1b3-09d3-4e73-a5ac-39d19eee29ea tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:56.257772 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-91f8d184-ada4-4c8d-8e7f-28bbb556d097 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:56.279901 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-91f8d184-ada4-4c8d-8e7f-28bbb556d097 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1358 microversion: 2.1 time: 0.241025 Sep 21 12:24:56.280752 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 264/517] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:56 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:24:56.388273 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-1e6ca1b3-09d3-4e73-a5ac-39d19eee29ea tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:56.396517 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-1e6ca1b3-09d3-4e73-a5ac-39d19eee29ea tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1511 microversion: 2.1 time: 0.157589 Sep 21 12:24:56.397088 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 254/518] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:56 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:24:57.190794 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-7bcf23c5-52e2-4f29-ad42-81e431e58978 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:57.192132 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-7bcf23c5-52e2-4f29-ad42-81e431e58978 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:57.199957 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7bcf23c5-52e2-4f29-ad42-81e431e58978 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:57.200458 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7bcf23c5-52e2-4f29-ad42-81e431e58978 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:57.200900 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7bcf23c5-52e2-4f29-ad42-81e431e58978 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:57.202138 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7bcf23c5-52e2-4f29-ad42-81e431e58978 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:57.202776 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7bcf23c5-52e2-4f29-ad42-81e431e58978 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:57.203359 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7bcf23c5-52e2-4f29-ad42-81e431e58978 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:57.305030 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-2c7712a0-46e8-45e7-8eee-0b54ed1af8f8 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:57.305639 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-2c7712a0-46e8-45e7-8eee-0b54ed1af8f8 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:57.312311 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2c7712a0-46e8-45e7-8eee-0b54ed1af8f8 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:57.312804 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2c7712a0-46e8-45e7-8eee-0b54ed1af8f8 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:57.313247 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2c7712a0-46e8-45e7-8eee-0b54ed1af8f8 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:57.313956 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2c7712a0-46e8-45e7-8eee-0b54ed1af8f8 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:57.314416 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2c7712a0-46e8-45e7-8eee-0b54ed1af8f8 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:57.314851 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2c7712a0-46e8-45e7-8eee-0b54ed1af8f8 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:57.356243 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-7bcf23c5-52e2-4f29-ad42-81e431e58978 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:57.364456 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-7bcf23c5-52e2-4f29-ad42-81e431e58978 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:57.365941 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-7bcf23c5-52e2-4f29-ad42-81e431e58978 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:57.367132 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-7bcf23c5-52e2-4f29-ad42-81e431e58978 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1725 microversion: 2.20 time: 0.180316 Sep 21 12:24:57.367699 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 265/519] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:24:57 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:24:57.419461 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-6ddcac00-278b-4f34-b0b6-c7d6de9e4a13 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:57.420314 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-6ddcac00-278b-4f34-b0b6-c7d6de9e4a13 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:57.426291 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6ddcac00-278b-4f34-b0b6-c7d6de9e4a13 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:57.426935 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6ddcac00-278b-4f34-b0b6-c7d6de9e4a13 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:57.427272 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6ddcac00-278b-4f34-b0b6-c7d6de9e4a13 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:57.428040 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6ddcac00-278b-4f34-b0b6-c7d6de9e4a13 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:57.428501 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6ddcac00-278b-4f34-b0b6-c7d6de9e4a13 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:57.428969 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6ddcac00-278b-4f34-b0b6-c7d6de9e4a13 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:57.457355 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-2c7712a0-46e8-45e7-8eee-0b54ed1af8f8 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:57.465164 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-2c7712a0-46e8-45e7-8eee-0b54ed1af8f8 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1358 microversion: 2.1 time: 0.163967 Sep 21 12:24:57.465739 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 255/520] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:57 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:24:57.626984 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-6ddcac00-278b-4f34-b0b6-c7d6de9e4a13 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:57.635472 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-6ddcac00-278b-4f34-b0b6-c7d6de9e4a13 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1511 microversion: 2.1 time: 0.219823 Sep 21 12:24:57.650216 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 266/521] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:57 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1511 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:24:58.392511 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-e8741c7f-6b1c-4f1e-baff-f36b56086113 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:58.393137 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-e8741c7f-6b1c-4f1e-baff-f36b56086113 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:58.399450 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e8741c7f-6b1c-4f1e-baff-f36b56086113 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:58.399963 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e8741c7f-6b1c-4f1e-baff-f36b56086113 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:58.400403 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e8741c7f-6b1c-4f1e-baff-f36b56086113 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:58.401098 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e8741c7f-6b1c-4f1e-baff-f36b56086113 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:58.401555 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e8741c7f-6b1c-4f1e-baff-f36b56086113 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:58.401982 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e8741c7f-6b1c-4f1e-baff-f36b56086113 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:58.490329 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-3cf33684-8b00-4f9b-aa26-8eaee123b464 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:58.491093 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-3cf33684-8b00-4f9b-aa26-8eaee123b464 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:58.497214 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3cf33684-8b00-4f9b-aa26-8eaee123b464 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:58.497670 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3cf33684-8b00-4f9b-aa26-8eaee123b464 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:58.498152 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3cf33684-8b00-4f9b-aa26-8eaee123b464 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:58.498858 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3cf33684-8b00-4f9b-aa26-8eaee123b464 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:58.499320 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3cf33684-8b00-4f9b-aa26-8eaee123b464 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:58.499746 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3cf33684-8b00-4f9b-aa26-8eaee123b464 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:58.576044 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-e8741c7f-6b1c-4f1e-baff-f36b56086113 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:58.584830 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-e8741c7f-6b1c-4f1e-baff-f36b56086113 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:58.588426 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-e8741c7f-6b1c-4f1e-baff-f36b56086113 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:58.589865 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-e8741c7f-6b1c-4f1e-baff-f36b56086113 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1725 microversion: 2.20 time: 0.201250 Sep 21 12:24:58.590903 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 256/522] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:24:58 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1725 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:24:58.596272 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-035666c5-3225-4b3f-a05b-31435b3bd195 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:24:58.602948 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-035666c5-3225-4b3f-a05b-31435b3bd195 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:58.603747 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-035666c5-3225-4b3f-a05b-31435b3bd195 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:58.604325 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-035666c5-3225-4b3f-a05b-31435b3bd195 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:58.655707 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-3cf33684-8b00-4f9b-aa26-8eaee123b464 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:58.665435 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-3cf33684-8b00-4f9b-aa26-8eaee123b464 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1358 microversion: 2.1 time: 0.178872 Sep 21 12:24:58.666106 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 267/523] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:58 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:24:58.671332 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-9640d0fa-4cb1-4b0f-a1e1-c793bdf15cbe tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:58.671979 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-9640d0fa-4cb1-4b0f-a1e1-c793bdf15cbe tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:58.673525 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-035666c5-3225-4b3f-a05b-31435b3bd195 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Going to try to stop instance {{(pid=120463) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 21 12:24:58.677903 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9640d0fa-4cb1-4b0f-a1e1-c793bdf15cbe tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:58.678401 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9640d0fa-4cb1-4b0f-a1e1-c793bdf15cbe tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:58.678878 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9640d0fa-4cb1-4b0f-a1e1-c793bdf15cbe tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:58.679579 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9640d0fa-4cb1-4b0f-a1e1-c793bdf15cbe tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:58.680226 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9640d0fa-4cb1-4b0f-a1e1-c793bdf15cbe tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:58.680814 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9640d0fa-4cb1-4b0f-a1e1-c793bdf15cbe tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:58.719210 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-035666c5-3225-4b3f-a05b-31435b3bd195 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "POST /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e/action" status: 202 len: 0 microversion: 2.1 time: 0.127194 Sep 21 12:24:58.719848 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 257/524] 10.222.0.71 () {60 vars in 1278 bytes} [Wed Sep 21 12:24:58 2022] POST /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 12:24:58.728109 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-6f1395ce-d06c-4feb-b67c-7a8955ac8275 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:58.728818 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-6f1395ce-d06c-4feb-b67c-7a8955ac8275 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:58.734882 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6f1395ce-d06c-4feb-b67c-7a8955ac8275 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:58.735352 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6f1395ce-d06c-4feb-b67c-7a8955ac8275 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:58.735822 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6f1395ce-d06c-4feb-b67c-7a8955ac8275 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:58.736584 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6f1395ce-d06c-4feb-b67c-7a8955ac8275 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:58.737027 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6f1395ce-d06c-4feb-b67c-7a8955ac8275 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:58.737502 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6f1395ce-d06c-4feb-b67c-7a8955ac8275 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:58.813230 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-9640d0fa-4cb1-4b0f-a1e1-c793bdf15cbe tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:58.821614 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-9640d0fa-4cb1-4b0f-a1e1-c793bdf15cbe tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1511 microversion: 2.1 time: 0.154099 Sep 21 12:24:58.822254 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 268/525] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:58 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:24:58.876836 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-6f1395ce-d06c-4feb-b67c-7a8955ac8275 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:58.885345 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-6f1395ce-d06c-4feb-b67c-7a8955ac8275 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1722 microversion: 2.1 time: 0.161285 Sep 21 12:24:58.885925 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 258/526] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:58 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:24:59.617294 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-7caed09b-7c6c-4154-aacb-c92b1caf6745 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:59.617907 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-7caed09b-7c6c-4154-aacb-c92b1caf6745 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:59.624502 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7caed09b-7c6c-4154-aacb-c92b1caf6745 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:59.624984 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7caed09b-7c6c-4154-aacb-c92b1caf6745 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:59.625418 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7caed09b-7c6c-4154-aacb-c92b1caf6745 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:59.626123 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7caed09b-7c6c-4154-aacb-c92b1caf6745 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:59.626592 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7caed09b-7c6c-4154-aacb-c92b1caf6745 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:59.627023 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7caed09b-7c6c-4154-aacb-c92b1caf6745 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:59.689464 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-a4921a7d-29b0-4993-b734-e01b5a85c1ea tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:59.690088 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-a4921a7d-29b0-4993-b734-e01b5a85c1ea tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:59.696575 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a4921a7d-29b0-4993-b734-e01b5a85c1ea tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:59.697066 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a4921a7d-29b0-4993-b734-e01b5a85c1ea tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:59.697515 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a4921a7d-29b0-4993-b734-e01b5a85c1ea tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:59.698216 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a4921a7d-29b0-4993-b734-e01b5a85c1ea tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:59.698674 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a4921a7d-29b0-4993-b734-e01b5a85c1ea tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:59.699108 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a4921a7d-29b0-4993-b734-e01b5a85c1ea tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:59.757718 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-7caed09b-7c6c-4154-aacb-c92b1caf6745 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:59.766403 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-7caed09b-7c6c-4154-aacb-c92b1caf6745 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:59.767932 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-7caed09b-7c6c-4154-aacb-c92b1caf6745 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:59.769136 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-7caed09b-7c6c-4154-aacb-c92b1caf6745 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1725 microversion: 2.20 time: 0.155754 Sep 21 12:24:59.769737 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 269/527] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:24:59 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:24:59.831438 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a4921a7d-29b0-4993-b734-e01b5a85c1ea tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:59.844203 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-a4921a7d-29b0-4993-b734-e01b5a85c1ea tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1358 microversion: 2.1 time: 0.159120 Sep 21 12:24:59.845099 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-eac5f966-5995-4279-b171-eb394d8a18b9 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:59.845717 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-eac5f966-5995-4279-b171-eb394d8a18b9 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:59.846300 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 259/528] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:59 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:24:59.851645 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-eac5f966-5995-4279-b171-eb394d8a18b9 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:59.852173 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-eac5f966-5995-4279-b171-eb394d8a18b9 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:59.852608 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-eac5f966-5995-4279-b171-eb394d8a18b9 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:59.853306 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-eac5f966-5995-4279-b171-eb394d8a18b9 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:59.853757 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-eac5f966-5995-4279-b171-eb394d8a18b9 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:59.854183 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-eac5f966-5995-4279-b171-eb394d8a18b9 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:59.909752 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-14db06a9-bb1e-4589-a83a-03f8fe35972a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:24:59.910528 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-14db06a9-bb1e-4589-a83a-03f8fe35972a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:24:59.916491 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-14db06a9-bb1e-4589-a83a-03f8fe35972a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:59.916985 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-14db06a9-bb1e-4589-a83a-03f8fe35972a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:59.917429 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-14db06a9-bb1e-4589-a83a-03f8fe35972a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:59.918129 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-14db06a9-bb1e-4589-a83a-03f8fe35972a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:24:59.918594 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-14db06a9-bb1e-4589-a83a-03f8fe35972a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:24:59.919026 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-14db06a9-bb1e-4589-a83a-03f8fe35972a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:24:59.983721 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-eac5f966-5995-4279-b171-eb394d8a18b9 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:24:59.991435 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-eac5f966-5995-4279-b171-eb394d8a18b9 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1511 microversion: 2.1 time: 0.150574 Sep 21 12:24:59.992257 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 270/529] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:59 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:25:00.048501 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-14db06a9-bb1e-4589-a83a-03f8fe35972a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:00.056622 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-14db06a9-bb1e-4589-a83a-03f8fe35972a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1722 microversion: 2.1 time: 0.150731 Sep 21 12:25:00.057194 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 260/530] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:24:59 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:25:00.505938 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-06e0586d-bb9e-4b38-adcf-413d9e4342c2 req-308c0c6b-31cf-445a-bf73-41a4cb6337a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc8e107-efaf-4689-9e8f-f8adc955c6d9", "name": "network-vif-plugged", "status": "completed", "tag": "2d86ac1e-8e22-4863-a099-2f5b0b120e07"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:25:00.516579 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-06e0586d-bb9e-4b38-adcf-413d9e4342c2 req-308c0c6b-31cf-445a-bf73-41a4cb6337a7 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:00.517637 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-06e0586d-bb9e-4b38-adcf-413d9e4342c2 req-308c0c6b-31cf-445a-bf73-41a4cb6337a7 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:00.518096 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-06e0586d-bb9e-4b38-adcf-413d9e4342c2 req-308c0c6b-31cf-445a-bf73-41a4cb6337a7 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:00.530135 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-06e0586d-bb9e-4b38-adcf-413d9e4342c2 req-308c0c6b-31cf-445a-bf73-41a4cb6337a7 service nova] Creating event network-vif-plugged:2d86ac1e-8e22-4863-a099-2f5b0b120e07 for instance 3cc8e107-efaf-4689-9e8f-f8adc955c6d9 on hv-cinder-85867 Sep 21 12:25:00.535982 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-06e0586d-bb9e-4b38-adcf-413d9e4342c2 req-308c0c6b-31cf-445a-bf73-41a4cb6337a7 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033978 Sep 21 12:25:00.536746 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 271/531] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:25:00.794519 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-a527d6c8-67ff-43be-b925-5eb31be79923 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:00.795137 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-a527d6c8-67ff-43be-b925-5eb31be79923 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:00.801714 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a527d6c8-67ff-43be-b925-5eb31be79923 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:00.802204 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a527d6c8-67ff-43be-b925-5eb31be79923 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:00.802652 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a527d6c8-67ff-43be-b925-5eb31be79923 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:00.803348 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a527d6c8-67ff-43be-b925-5eb31be79923 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:00.803834 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a527d6c8-67ff-43be-b925-5eb31be79923 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:00.804274 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a527d6c8-67ff-43be-b925-5eb31be79923 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:00.867800 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-4d114a15-d570-4897-b1e7-78a595bae38e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:00.867800 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-4d114a15-d570-4897-b1e7-78a595bae38e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:00.874203 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4d114a15-d570-4897-b1e7-78a595bae38e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:00.875195 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4d114a15-d570-4897-b1e7-78a595bae38e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:00.875639 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4d114a15-d570-4897-b1e7-78a595bae38e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:00.876390 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4d114a15-d570-4897-b1e7-78a595bae38e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:00.876850 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4d114a15-d570-4897-b1e7-78a595bae38e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:00.877290 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4d114a15-d570-4897-b1e7-78a595bae38e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:00.937530 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a527d6c8-67ff-43be-b925-5eb31be79923 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:00.946279 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a527d6c8-67ff-43be-b925-5eb31be79923 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:00.947740 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a527d6c8-67ff-43be-b925-5eb31be79923 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:00.948962 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-a527d6c8-67ff-43be-b925-5eb31be79923 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1725 microversion: 2.20 time: 0.158478 Sep 21 12:25:00.949530 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 261/532] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:00 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:01.014078 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-4d114a15-d570-4897-b1e7-78a595bae38e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:01.017291 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-f0252214-e25a-49c6-85f3-4835cc3206bf tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:01.018101 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-f0252214-e25a-49c6-85f3-4835cc3206bf tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:01.024592 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-4d114a15-d570-4897-b1e7-78a595bae38e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1358 microversion: 2.1 time: 0.161543 Sep 21 12:25:01.025728 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 272/533] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:00 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:25:01.025979 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f0252214-e25a-49c6-85f3-4835cc3206bf tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:01.026542 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f0252214-e25a-49c6-85f3-4835cc3206bf tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:01.026986 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f0252214-e25a-49c6-85f3-4835cc3206bf tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:01.027745 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f0252214-e25a-49c6-85f3-4835cc3206bf tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:01.028358 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f0252214-e25a-49c6-85f3-4835cc3206bf tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:01.028780 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f0252214-e25a-49c6-85f3-4835cc3206bf tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:01.080409 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-8bf63d3c-49f2-40ac-a019-8a2e2f382ba9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:01.081140 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-8bf63d3c-49f2-40ac-a019-8a2e2f382ba9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:01.087101 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8bf63d3c-49f2-40ac-a019-8a2e2f382ba9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:01.087669 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8bf63d3c-49f2-40ac-a019-8a2e2f382ba9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:01.088819 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8bf63d3c-49f2-40ac-a019-8a2e2f382ba9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:01.089561 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8bf63d3c-49f2-40ac-a019-8a2e2f382ba9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:01.090130 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8bf63d3c-49f2-40ac-a019-8a2e2f382ba9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:01.090627 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8bf63d3c-49f2-40ac-a019-8a2e2f382ba9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:01.163561 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-f0252214-e25a-49c6-85f3-4835cc3206bf tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:01.172379 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-f0252214-e25a-49c6-85f3-4835cc3206bf tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1517 microversion: 2.1 time: 0.159390 Sep 21 12:25:01.172972 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 262/534] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:01 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:25:01.221929 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-8bf63d3c-49f2-40ac-a019-8a2e2f382ba9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:01.230241 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-8bf63d3c-49f2-40ac-a019-8a2e2f382ba9 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1722 microversion: 2.1 time: 0.154115 Sep 21 12:25:01.230927 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 273/535] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:01 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:25:01.975176 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-830559c4-0eb8-48a8-84f5-2de21b27d4e9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:01.975793 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-830559c4-0eb8-48a8-84f5-2de21b27d4e9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:01.982240 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-830559c4-0eb8-48a8-84f5-2de21b27d4e9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:01.982724 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-830559c4-0eb8-48a8-84f5-2de21b27d4e9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:01.983164 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-830559c4-0eb8-48a8-84f5-2de21b27d4e9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:01.983888 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-830559c4-0eb8-48a8-84f5-2de21b27d4e9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:01.984344 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-830559c4-0eb8-48a8-84f5-2de21b27d4e9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:01.984771 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-830559c4-0eb8-48a8-84f5-2de21b27d4e9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:02.053258 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-c601c210-a148-4114-b5e7-75827b40dfbb tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:02.053870 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-c601c210-a148-4114-b5e7-75827b40dfbb tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:02.059826 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c601c210-a148-4114-b5e7-75827b40dfbb tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:02.060750 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c601c210-a148-4114-b5e7-75827b40dfbb tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:02.060750 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c601c210-a148-4114-b5e7-75827b40dfbb tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:02.061435 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c601c210-a148-4114-b5e7-75827b40dfbb tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:02.062378 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c601c210-a148-4114-b5e7-75827b40dfbb tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:02.063126 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c601c210-a148-4114-b5e7-75827b40dfbb tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:02.114942 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-830559c4-0eb8-48a8-84f5-2de21b27d4e9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:02.123246 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-830559c4-0eb8-48a8-84f5-2de21b27d4e9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:02.125223 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-830559c4-0eb8-48a8-84f5-2de21b27d4e9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:02.126396 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-830559c4-0eb8-48a8-84f5-2de21b27d4e9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1725 microversion: 2.20 time: 0.155112 Sep 21 12:25:02.126967 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 263/536] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:01 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:02.192435 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-c601c210-a148-4114-b5e7-75827b40dfbb tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:02.201069 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-c601c210-a148-4114-b5e7-75827b40dfbb tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1358 microversion: 2.1 time: 0.151700 Sep 21 12:25:02.201660 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 274/537] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:02 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:25:02.254910 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-4ee43d5e-3b68-4a08-bedf-c9a2a8daf772 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:02.255436 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-4ee43d5e-3b68-4a08-bedf-c9a2a8daf772 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:02.262130 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4ee43d5e-3b68-4a08-bedf-c9a2a8daf772 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:02.262619 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4ee43d5e-3b68-4a08-bedf-c9a2a8daf772 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:02.263058 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4ee43d5e-3b68-4a08-bedf-c9a2a8daf772 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:02.263772 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4ee43d5e-3b68-4a08-bedf-c9a2a8daf772 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:02.264234 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4ee43d5e-3b68-4a08-bedf-c9a2a8daf772 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:02.264662 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4ee43d5e-3b68-4a08-bedf-c9a2a8daf772 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:02.407669 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-4ee43d5e-3b68-4a08-bedf-c9a2a8daf772 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:02.416377 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-4ee43d5e-3b68-4a08-bedf-c9a2a8daf772 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1722 microversion: 2.1 time: 0.165360 Sep 21 12:25:02.416960 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 264/538] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:02 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:25:02.525265 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-9c219f8a-2907-4c21-87a8-0d446e4d215b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Action: 'create', calling method: .version_select at 0x7fe4c90e3ee0>, body: {"keypair": {"name": "tempest-keypair-1178823482", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXi7R6hLf0Lxb5TKAPq+VI4FsD6Nhq/gY9cVngBAwvWTTec3lKbPXYCrA/kxkcRPDPWUgyJaRk2lOtvWzd5xEnk0rftoP9bANpo/bcZRU3tBIWHUIqqSn7fzZyqG2qpxw=="}} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:25:02.541045 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-9c219f8a-2907-4c21-87a8-0d446e4d215b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Getting quotas for project d3bd02ae79fd4edb9886b1b4ef3d761a. Resources: {'key_pairs'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 12:25:02.544841 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-9c219f8a-2907-4c21-87a8-0d446e4d215b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Getting quotas for user 0fb9105e474a4a29904722b1e33d0155 and project d3bd02ae79fd4edb9886b1b4ef3d761a. Resources: {'key_pairs'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 12:25:02.568474 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-9c219f8a-2907-4c21-87a8-0d446e4d215b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047062 Sep 21 12:25:02.569137 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 275/539] 10.222.0.71 () {60 vars in 1159 bytes} [Wed Sep 21 12:25:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:25:03.151544 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-35b41352-8a49-4f09-978c-35bcf61528d4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:03.152313 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-35b41352-8a49-4f09-978c-35bcf61528d4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:03.158802 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-35b41352-8a49-4f09-978c-35bcf61528d4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:03.159320 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-35b41352-8a49-4f09-978c-35bcf61528d4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:03.159810 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-35b41352-8a49-4f09-978c-35bcf61528d4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:03.160465 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-35b41352-8a49-4f09-978c-35bcf61528d4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:03.160924 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-35b41352-8a49-4f09-978c-35bcf61528d4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:03.161358 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-35b41352-8a49-4f09-978c-35bcf61528d4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:03.224569 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-94af9631-91ff-4828-b524-51fa76e180d1 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:03.225214 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-94af9631-91ff-4828-b524-51fa76e180d1 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:03.231273 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-94af9631-91ff-4828-b524-51fa76e180d1 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:03.231790 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-94af9631-91ff-4828-b524-51fa76e180d1 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:03.232234 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-94af9631-91ff-4828-b524-51fa76e180d1 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:03.232928 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-94af9631-91ff-4828-b524-51fa76e180d1 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:03.233388 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-94af9631-91ff-4828-b524-51fa76e180d1 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:03.233820 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-94af9631-91ff-4828-b524-51fa76e180d1 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:03.366268 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-35b41352-8a49-4f09-978c-35bcf61528d4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:03.376007 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-35b41352-8a49-4f09-978c-35bcf61528d4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:03.377777 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-35b41352-8a49-4f09-978c-35bcf61528d4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:03.378561 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-94af9631-91ff-4828-b524-51fa76e180d1 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:03.379235 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-35b41352-8a49-4f09-978c-35bcf61528d4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1746 microversion: 2.20 time: 0.231702 Sep 21 12:25:03.380621 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 265/540] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:03 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1746 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:03.386581 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-94af9631-91ff-4828-b524-51fa76e180d1 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1358 microversion: 2.1 time: 0.166026 Sep 21 12:25:03.387565 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 276/541] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:03 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:25:03.440427 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-bfe7e0a6-2716-40db-9f35-e75cb6e53a27 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:03.441234 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-bfe7e0a6-2716-40db-9f35-e75cb6e53a27 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:03.447518 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bfe7e0a6-2716-40db-9f35-e75cb6e53a27 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:03.448050 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bfe7e0a6-2716-40db-9f35-e75cb6e53a27 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:03.448485 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bfe7e0a6-2716-40db-9f35-e75cb6e53a27 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:03.449183 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bfe7e0a6-2716-40db-9f35-e75cb6e53a27 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:03.449639 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bfe7e0a6-2716-40db-9f35-e75cb6e53a27 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:03.450066 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bfe7e0a6-2716-40db-9f35-e75cb6e53a27 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:03.468268 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:25:03.648198 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-bfe7e0a6-2716-40db-9f35-e75cb6e53a27 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:03.657122 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-bfe7e0a6-2716-40db-9f35-e75cb6e53a27 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1722 microversion: 2.1 time: 0.221126 Sep 21 12:25:03.657696 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 266/542] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:03 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:25:03.996660 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-4918c805-7196-432e-b1bd-d74e5ed52c78 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-129813012", "imageRef": "1e3a8d95-6338-499c-af91-e3d1345af950", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46771c4a-a4e0-44e3-b0ad-6700b1914d9d"}], "security_groups": [{"name": "tempest-securitygroup--754322468"}], "key_name": "tempest-keypair-1178823482", "user_data": "}} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:25:04.098493 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.network.neutron [None req-4918c805-7196-432e-b1bd-d74e5ed52c78 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] validate_networks() for [('46771c4a-a4e0-44e3-b0ad-6700b1914d9d', None, None, None, None, None)] {{(pid=120462) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 12:25:04.406954 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-504c56c2-3818-4ea1-a287-0283e6526db1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:04.407568 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-504c56c2-3818-4ea1-a287-0283e6526db1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:04.413986 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-504c56c2-3818-4ea1-a287-0283e6526db1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:04.414465 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-504c56c2-3818-4ea1-a287-0283e6526db1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:04.414898 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-504c56c2-3818-4ea1-a287-0283e6526db1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:04.416174 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-504c56c2-3818-4ea1-a287-0283e6526db1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:04.416634 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-504c56c2-3818-4ea1-a287-0283e6526db1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:04.417051 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-504c56c2-3818-4ea1-a287-0283e6526db1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:04.582701 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-504c56c2-3818-4ea1-a287-0283e6526db1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:04.594501 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-504c56c2-3818-4ea1-a287-0283e6526db1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:04.596500 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-504c56c2-3818-4ea1-a287-0283e6526db1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:04.600159 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-504c56c2-3818-4ea1-a287-0283e6526db1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1746 microversion: 2.20 time: 0.198627 Sep 21 12:25:04.601318 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 267/543] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:04 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1746 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:25:04.608420 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-bc21e187-174c-4076-a509-30b1a693355d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:04.609902 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-bc21e187-174c-4076-a509-30b1a693355d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:04.616866 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bc21e187-174c-4076-a509-30b1a693355d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:04.617509 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bc21e187-174c-4076-a509-30b1a693355d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:04.618200 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bc21e187-174c-4076-a509-30b1a693355d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:04.619107 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bc21e187-174c-4076-a509-30b1a693355d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:04.619941 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bc21e187-174c-4076-a509-30b1a693355d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:04.620546 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bc21e187-174c-4076-a509-30b1a693355d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:04.726544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-4918c805-7196-432e-b1bd-d74e5ed52c78 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Flavor limits 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 12:25:04.727456 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-4918c805-7196-432e-b1bd-d74e5ed52c78 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Image limits 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 12:25:04.727996 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-4918c805-7196-432e-b1bd-d74e5ed52c78 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Flavor pref 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 12:25:04.728439 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-4918c805-7196-432e-b1bd-d74e5ed52c78 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Image pref 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 12:25:04.728847 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-4918c805-7196-432e-b1bd-d74e5ed52c78 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 12:25:04.737939 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4918c805-7196-432e-b1bd-d74e5ed52c78 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:04.738338 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4918c805-7196-432e-b1bd-d74e5ed52c78 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:04.738959 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4918c805-7196-432e-b1bd-d74e5ed52c78 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:04.739734 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4918c805-7196-432e-b1bd-d74e5ed52c78 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:04.740219 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4918c805-7196-432e-b1bd-d74e5ed52c78 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:04.740659 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4918c805-7196-432e-b1bd-d74e5ed52c78 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:04.762653 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-4918c805-7196-432e-b1bd-d74e5ed52c78 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Getting quotas for project d3bd02ae79fd4edb9886b1b4ef3d761a. Resources: {'instances', 'ram', 'cores'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 12:25:04.768251 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-4918c805-7196-432e-b1bd-d74e5ed52c78 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Getting quotas for user 0fb9105e474a4a29904722b1e33d0155 and project d3bd02ae79fd4edb9886b1b4ef3d761a. Resources: {'instances', 'ram', 'cores'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 12:25:04.771055 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-bc21e187-174c-4076-a509-30b1a693355d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:04.778915 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-bc21e187-174c-4076-a509-30b1a693355d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1358 microversion: 2.1 time: 0.176368 Sep 21 12:25:04.779510 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 268/544] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:04 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:25:04.784733 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-67674b26-8889-4498-9326-acdf1c9329db tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:04.785338 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-67674b26-8889-4498-9326-acdf1c9329db tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:04.785719 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-4918c805-7196-432e-b1bd-d74e5ed52c78 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Going to run 1 instances... {{(pid=120462) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 12:25:04.788145 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-4918c805-7196-432e-b1bd-d74e5ed52c78 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e3a8d95-6338-499c-af91-e3d1345af950',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 12:25:04.791377 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-67674b26-8889-4498-9326-acdf1c9329db tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:04.791925 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-67674b26-8889-4498-9326-acdf1c9329db tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:04.792365 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-67674b26-8889-4498-9326-acdf1c9329db tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:04.793072 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-67674b26-8889-4498-9326-acdf1c9329db tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:04.793535 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-67674b26-8889-4498-9326-acdf1c9329db tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:04.793965 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-67674b26-8889-4498-9326-acdf1c9329db tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:04.840147 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-4918c805-7196-432e-b1bd-d74e5ed52c78 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.847578 Sep 21 12:25:04.848691 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 277/545] 10.222.0.71 () {60 vars in 1147 bytes} [Wed Sep 21 12:25:03 2022] POST /compute/v2.1/servers => generated 408 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 21 12:25:04.854444 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-38451be0-130a-4734-8fde-00ecd423d9cc tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:04.855230 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-38451be0-130a-4734-8fde-00ecd423d9cc tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:04.919564 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-38451be0-130a-4734-8fde-00ecd423d9cc tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:04.928047 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-38451be0-130a-4734-8fde-00ecd423d9cc tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1245 microversion: 2.1 time: 0.077945 Sep 21 12:25:04.928906 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 278/546] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:04 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1245 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:25:04.974763 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-67674b26-8889-4498-9326-acdf1c9329db tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:04.984974 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-67674b26-8889-4498-9326-acdf1c9329db tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1722 microversion: 2.1 time: 0.203635 Sep 21 12:25:04.987808 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 269/547] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:04 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:25:05.627241 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-81182380-91de-4aba-9403-eabe7bd975e1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:05.627959 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-81182380-91de-4aba-9403-eabe7bd975e1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:05.634227 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-81182380-91de-4aba-9403-eabe7bd975e1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:05.634712 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-81182380-91de-4aba-9403-eabe7bd975e1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:05.635143 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-81182380-91de-4aba-9403-eabe7bd975e1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:05.635857 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-81182380-91de-4aba-9403-eabe7bd975e1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:05.636309 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-81182380-91de-4aba-9403-eabe7bd975e1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:05.636732 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-81182380-91de-4aba-9403-eabe7bd975e1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:05.771745 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-81182380-91de-4aba-9403-eabe7bd975e1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:05.779985 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-81182380-91de-4aba-9403-eabe7bd975e1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:05.782023 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-81182380-91de-4aba-9403-eabe7bd975e1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:05.783195 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-81182380-91de-4aba-9403-eabe7bd975e1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1746 microversion: 2.20 time: 0.160670 Sep 21 12:25:05.783777 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 279/548] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:05 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:05.805393 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-2dde6816-c7e7-43ce-8056-902e1b481b55 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:05.805965 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-2dde6816-c7e7-43ce-8056-902e1b481b55 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:05.812778 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2dde6816-c7e7-43ce-8056-902e1b481b55 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:05.813259 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2dde6816-c7e7-43ce-8056-902e1b481b55 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:05.813699 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2dde6816-c7e7-43ce-8056-902e1b481b55 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:05.814403 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2dde6816-c7e7-43ce-8056-902e1b481b55 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:05.814868 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2dde6816-c7e7-43ce-8056-902e1b481b55 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:05.815297 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2dde6816-c7e7-43ce-8056-902e1b481b55 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:05.950593 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-502c8154-74f3-4ab0-a14c-d599f943294a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:05.951331 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-502c8154-74f3-4ab0-a14c-d599f943294a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:05.955056 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-2dde6816-c7e7-43ce-8056-902e1b481b55 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:05.958116 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-502c8154-74f3-4ab0-a14c-d599f943294a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:05.958611 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-502c8154-74f3-4ab0-a14c-d599f943294a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:05.959049 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-502c8154-74f3-4ab0-a14c-d599f943294a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:05.959749 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-502c8154-74f3-4ab0-a14c-d599f943294a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:05.960233 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-502c8154-74f3-4ab0-a14c-d599f943294a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:05.960660 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-502c8154-74f3-4ab0-a14c-d599f943294a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:05.964111 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-2dde6816-c7e7-43ce-8056-902e1b481b55 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1547 microversion: 2.1 time: 0.163570 Sep 21 12:25:05.964711 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 270/549] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:05 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1547 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:25:05.988269 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-30b23a08-1e26-4c62-83c1-7234f13ab6e9 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:05.988897 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-30b23a08-1e26-4c62-83c1-7234f13ab6e9 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:05.995030 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-30b23a08-1e26-4c62-83c1-7234f13ab6e9 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:05.995524 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-30b23a08-1e26-4c62-83c1-7234f13ab6e9 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:05.996015 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-30b23a08-1e26-4c62-83c1-7234f13ab6e9 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:05.996722 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-30b23a08-1e26-4c62-83c1-7234f13ab6e9 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:05.997183 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-30b23a08-1e26-4c62-83c1-7234f13ab6e9 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:05.997614 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-30b23a08-1e26-4c62-83c1-7234f13ab6e9 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:06.029992 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-502c8154-74f3-4ab0-a14c-d599f943294a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:06.038447 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-502c8154-74f3-4ab0-a14c-d599f943294a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1297 microversion: 2.1 time: 0.091682 Sep 21 12:25:06.039053 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 280/550] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:05 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1297 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:25:06.044039 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-37631e67-c297-4aaa-9649-e4525b4a7b70 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:06.044586 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-37631e67-c297-4aaa-9649-e4525b4a7b70 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:06.051285 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-37631e67-c297-4aaa-9649-e4525b4a7b70 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:06.051803 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-37631e67-c297-4aaa-9649-e4525b4a7b70 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:06.052246 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-37631e67-c297-4aaa-9649-e4525b4a7b70 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:06.052959 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-37631e67-c297-4aaa-9649-e4525b4a7b70 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:06.053419 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-37631e67-c297-4aaa-9649-e4525b4a7b70 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:06.053844 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-37631e67-c297-4aaa-9649-e4525b4a7b70 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:06.138914 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-30b23a08-1e26-4c62-83c1-7234f13ab6e9 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:06.149858 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-30b23a08-1e26-4c62-83c1-7234f13ab6e9 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1547 microversion: 2.1 time: 0.165861 Sep 21 12:25:06.163980 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 271/551] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:05 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1547 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:25:06.173769 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-a481973b-9c4b-4c05-b7f1-1955f30a3ae5 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:06.178688 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a481973b-9c4b-4c05-b7f1-1955f30a3ae5 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:06.179466 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-a481973b-9c4b-4c05-b7f1-1955f30a3ae5 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Searching by: {'deleted': False, 'project_id': '9de710fda38c429a91595545e9a74dcb'} {{(pid=120463) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 21 12:25:06.187374 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a481973b-9c4b-4c05-b7f1-1955f30a3ae5 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:06.187374 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a481973b-9c4b-4c05-b7f1-1955f30a3ae5 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:06.187693 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a481973b-9c4b-4c05-b7f1-1955f30a3ae5 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:06.188339 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a481973b-9c4b-4c05-b7f1-1955f30a3ae5 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:06.189007 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a481973b-9c4b-4c05-b7f1-1955f30a3ae5 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:06.189439 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a481973b-9c4b-4c05-b7f1-1955f30a3ae5 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:06.210828 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-37631e67-c297-4aaa-9649-e4525b4a7b70 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:06.219709 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-37631e67-c297-4aaa-9649-e4525b4a7b70 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1722 microversion: 2.1 time: 0.179489 Sep 21 12:25:06.220321 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 281/552] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:06 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:25:06.308769 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.multi_cell_list [None req-a481973b-9c4b-4c05-b7f1-1955f30a3ae5 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120463) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 21 12:25:06.425338 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-a481973b-9c4b-4c05-b7f1-1955f30a3ae5 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.255945 Sep 21 12:25:06.425945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 272/553] 10.222.0.71 () {58 vars in 1125 bytes} [Wed Sep 21 12:25:06 2022] GET /compute/v2.1/servers => generated 343 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 12:25:06.439637 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-0a119667-3a0d-4744-b5fb-e8f6d42a4060 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:06.440275 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-0a119667-3a0d-4744-b5fb-e8f6d42a4060 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:06.446580 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0a119667-3a0d-4744-b5fb-e8f6d42a4060 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:06.447068 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0a119667-3a0d-4744-b5fb-e8f6d42a4060 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:06.447509 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0a119667-3a0d-4744-b5fb-e8f6d42a4060 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:06.448232 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0a119667-3a0d-4744-b5fb-e8f6d42a4060 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:06.448687 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0a119667-3a0d-4744-b5fb-e8f6d42a4060 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:06.449112 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0a119667-3a0d-4744-b5fb-e8f6d42a4060 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:06.672827 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-0a119667-3a0d-4744-b5fb-e8f6d42a4060 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:06.681496 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-0a119667-3a0d-4744-b5fb-e8f6d42a4060 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1547 microversion: 2.1 time: 0.245647 Sep 21 12:25:06.682573 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 282/554] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:06 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1547 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:25:06.701485 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-e4c22359-1c94-4782-8b35-dce256e55bc4 req-51e69a32-80a4-4881-8e88-2e6e9ca2ddad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e9ebd08-4c95-43f6-a1a4-3268532d961e", "name": "network-vif-plugged", "status": "completed", "tag": "1f39c2aa-a245-4b77-8233-20f0c6c6cb30"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:25:06.728302 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-e4c22359-1c94-4782-8b35-dce256e55bc4 req-51e69a32-80a4-4881-8e88-2e6e9ca2ddad service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:06.729386 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-e4c22359-1c94-4782-8b35-dce256e55bc4 req-51e69a32-80a4-4881-8e88-2e6e9ca2ddad service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:06.730110 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-e4c22359-1c94-4782-8b35-dce256e55bc4 req-51e69a32-80a4-4881-8e88-2e6e9ca2ddad service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:06.750468 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-e4c22359-1c94-4782-8b35-dce256e55bc4 req-51e69a32-80a4-4881-8e88-2e6e9ca2ddad service nova] Creating event network-vif-plugged:1f39c2aa-a245-4b77-8233-20f0c6c6cb30 for instance 5e9ebd08-4c95-43f6-a1a4-3268532d961e on hv-cinder-85867 Sep 21 12:25:06.761109 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-e4c22359-1c94-4782-8b35-dce256e55bc4 req-51e69a32-80a4-4881-8e88-2e6e9ca2ddad service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076364 Sep 21 12:25:06.762296 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 273/555] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 12:25:06.811238 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-a0f32c2d-2b49-4c4e-aeab-765cad4d3166 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:06.812517 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-a0f32c2d-2b49-4c4e-aeab-765cad4d3166 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:06.819023 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a0f32c2d-2b49-4c4e-aeab-765cad4d3166 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:06.819807 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a0f32c2d-2b49-4c4e-aeab-765cad4d3166 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:06.820312 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a0f32c2d-2b49-4c4e-aeab-765cad4d3166 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:06.821079 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a0f32c2d-2b49-4c4e-aeab-765cad4d3166 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:06.821743 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a0f32c2d-2b49-4c4e-aeab-765cad4d3166 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:06.822358 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a0f32c2d-2b49-4c4e-aeab-765cad4d3166 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:07.054760 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-a0f32c2d-2b49-4c4e-aeab-765cad4d3166 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:07.063358 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-b1a4d19b-d067-4eca-b036-612d05891352 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:07.064330 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-b1a4d19b-d067-4eca-b036-612d05891352 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:07.070239 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-a0f32c2d-2b49-4c4e-aeab-765cad4d3166 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:07.072920 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-a0f32c2d-2b49-4c4e-aeab-765cad4d3166 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:07.074580 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b1a4d19b-d067-4eca-b036-612d05891352 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:07.075054 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-a0f32c2d-2b49-4c4e-aeab-765cad4d3166 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1746 microversion: 2.20 time: 0.267912 Sep 21 12:25:07.076274 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b1a4d19b-d067-4eca-b036-612d05891352 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:07.077221 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 283/556] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:06 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1746 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:25:07.090387 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b1a4d19b-d067-4eca-b036-612d05891352 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:07.090387 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b1a4d19b-d067-4eca-b036-612d05891352 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:07.090852 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b1a4d19b-d067-4eca-b036-612d05891352 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:07.091258 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b1a4d19b-d067-4eca-b036-612d05891352 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:07.244409 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-7bc7d2df-33b8-4c10-9a1f-15b55bffe7cc tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:07.245647 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-7bc7d2df-33b8-4c10-9a1f-15b55bffe7cc tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:07.255749 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7bc7d2df-33b8-4c10-9a1f-15b55bffe7cc tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:07.257255 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7bc7d2df-33b8-4c10-9a1f-15b55bffe7cc tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:07.258313 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7bc7d2df-33b8-4c10-9a1f-15b55bffe7cc tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:07.259300 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7bc7d2df-33b8-4c10-9a1f-15b55bffe7cc tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:07.260036 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7bc7d2df-33b8-4c10-9a1f-15b55bffe7cc tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:07.260786 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7bc7d2df-33b8-4c10-9a1f-15b55bffe7cc tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:07.266563 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=100 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:25:07.278639 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-b1a4d19b-d067-4eca-b036-612d05891352 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:07.291918 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-b1a4d19b-d067-4eca-b036-612d05891352 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1370 microversion: 2.1 time: 0.233074 Sep 21 12:25:07.292898 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 274/557] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:07 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1370 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:25:07.499850 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-7bc7d2df-33b8-4c10-9a1f-15b55bffe7cc tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:07.508365 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-7bc7d2df-33b8-4c10-9a1f-15b55bffe7cc tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1722 microversion: 2.1 time: 0.268152 Sep 21 12:25:07.520074 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 284/558] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:07 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1722 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:25:08.052501 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-ed6f7e50-f72b-44ec-9a4a-489159d1ac28 req-96397210-0c6f-42c3-9278-e274a612831b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f4f10b5-8953-4c76-a286-6974d7c88433", "tag": "0b66debc-125c-4397-a41e-08b95892a114"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:25:08.064139 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-ed6f7e50-f72b-44ec-9a4a-489159d1ac28 req-96397210-0c6f-42c3-9278-e274a612831b service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:08.064776 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-ed6f7e50-f72b-44ec-9a4a-489159d1ac28 req-96397210-0c6f-42c3-9278-e274a612831b service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:08.065203 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-ed6f7e50-f72b-44ec-9a4a-489159d1ac28 req-96397210-0c6f-42c3-9278-e274a612831b service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:08.076877 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-ed6f7e50-f72b-44ec-9a4a-489159d1ac28 req-96397210-0c6f-42c3-9278-e274a612831b service nova] Creating event network-changed:0b66debc-125c-4397-a41e-08b95892a114 for instance 5f4f10b5-8953-4c76-a286-6974d7c88433 on hv-cinder-85867 Sep 21 12:25:08.085226 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-ed6f7e50-f72b-44ec-9a4a-489159d1ac28 req-96397210-0c6f-42c3-9278-e274a612831b service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036739 Sep 21 12:25:08.085612 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 275/559] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 12:25:08.106569 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-d34774ae-4676-4a21-9254-43c8b6d1f4a8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:08.107181 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-d34774ae-4676-4a21-9254-43c8b6d1f4a8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:08.113442 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d34774ae-4676-4a21-9254-43c8b6d1f4a8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:08.113936 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d34774ae-4676-4a21-9254-43c8b6d1f4a8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:08.114377 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d34774ae-4676-4a21-9254-43c8b6d1f4a8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:08.115080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d34774ae-4676-4a21-9254-43c8b6d1f4a8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:08.115544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d34774ae-4676-4a21-9254-43c8b6d1f4a8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:08.116005 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d34774ae-4676-4a21-9254-43c8b6d1f4a8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:08.254712 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-d34774ae-4676-4a21-9254-43c8b6d1f4a8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:08.263964 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-d34774ae-4676-4a21-9254-43c8b6d1f4a8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:08.265987 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-d34774ae-4676-4a21-9254-43c8b6d1f4a8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:08.267205 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-d34774ae-4676-4a21-9254-43c8b6d1f4a8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1746 microversion: 2.20 time: 0.164649 Sep 21 12:25:08.267946 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 285/560] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:08 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:08.317648 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-976e4352-043b-4fd5-8616-14f83ff86284 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:08.318566 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-976e4352-043b-4fd5-8616-14f83ff86284 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:08.328430 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-976e4352-043b-4fd5-8616-14f83ff86284 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:08.329286 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-976e4352-043b-4fd5-8616-14f83ff86284 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:08.331399 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-976e4352-043b-4fd5-8616-14f83ff86284 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:08.332226 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-976e4352-043b-4fd5-8616-14f83ff86284 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:08.332718 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-976e4352-043b-4fd5-8616-14f83ff86284 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:08.333160 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-976e4352-043b-4fd5-8616-14f83ff86284 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:08.431747 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-42d4f61d-7706-413e-a66c-4bceb84884be tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3aa1f7c3-fbbf-444f-a798-a4fa323b706b"}} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:25:08.434588 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-42d4f61d-7706-413e-a66c-4bceb84884be tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:08.441766 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-42d4f61d-7706-413e-a66c-4bceb84884be tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:08.443181 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-42d4f61d-7706-413e-a66c-4bceb84884be tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:08.443980 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-42d4f61d-7706-413e-a66c-4bceb84884be tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:08.445035 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-42d4f61d-7706-413e-a66c-4bceb84884be tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:08.445721 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-42d4f61d-7706-413e-a66c-4bceb84884be tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:08.446358 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-42d4f61d-7706-413e-a66c-4bceb84884be tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:08.512570 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-976e4352-043b-4fd5-8616-14f83ff86284 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:08.521926 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-976e4352-043b-4fd5-8616-14f83ff86284 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1370 microversion: 2.1 time: 0.209768 Sep 21 12:25:08.523127 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 276/561] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:08 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1370 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:25:08.542962 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-18657efa-7b06-4b1f-b685-ab757a7ad0ab tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:08.543694 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-18657efa-7b06-4b1f-b685-ab757a7ad0ab tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:08.550916 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-18657efa-7b06-4b1f-b685-ab757a7ad0ab tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:08.551488 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-18657efa-7b06-4b1f-b685-ab757a7ad0ab tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:08.552101 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-18657efa-7b06-4b1f-b685-ab757a7ad0ab tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:08.552857 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-18657efa-7b06-4b1f-b685-ab757a7ad0ab tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:08.553479 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-18657efa-7b06-4b1f-b685-ab757a7ad0ab tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:08.553986 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-18657efa-7b06-4b1f-b685-ab757a7ad0ab tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:08.733087 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-18657efa-7b06-4b1f-b685-ab757a7ad0ab tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:08.742989 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-18657efa-7b06-4b1f-b685-ab757a7ad0ab tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1722 microversion: 2.1 time: 0.215309 Sep 21 12:25:08.757462 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 277/562] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:08 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:25:08.830627 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-42d4f61d-7706-413e-a66c-4bceb84884be tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "POST /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.404699 Sep 21 12:25:08.831137 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 286/563] 10.222.0.71 () {60 vars in 1323 bytes} [Wed Sep 21 12:25:08 2022] POST /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9/os-volume_attachments => generated 194 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:25:09.292766 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-a3f2331b-076b-4ed2-a1ca-4306bbf03f0f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:09.294109 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-a3f2331b-076b-4ed2-a1ca-4306bbf03f0f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:09.300866 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a3f2331b-076b-4ed2-a1ca-4306bbf03f0f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:09.301667 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a3f2331b-076b-4ed2-a1ca-4306bbf03f0f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:09.302265 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a3f2331b-076b-4ed2-a1ca-4306bbf03f0f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:09.303274 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a3f2331b-076b-4ed2-a1ca-4306bbf03f0f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:09.303827 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a3f2331b-076b-4ed2-a1ca-4306bbf03f0f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:09.304414 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a3f2331b-076b-4ed2-a1ca-4306bbf03f0f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:09.451592 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a3f2331b-076b-4ed2-a1ca-4306bbf03f0f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:09.462279 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a3f2331b-076b-4ed2-a1ca-4306bbf03f0f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:09.463820 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a3f2331b-076b-4ed2-a1ca-4306bbf03f0f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:09.465030 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-a3f2331b-076b-4ed2-a1ca-4306bbf03f0f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1741 microversion: 2.20 time: 0.176209 Sep 21 12:25:09.465633 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 278/564] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:09 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1741 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:09.547887 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-adf7e08d-e6d1-4842-b46f-e095f0d25289 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:09.548707 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-adf7e08d-e6d1-4842-b46f-e095f0d25289 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:09.558089 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-adf7e08d-e6d1-4842-b46f-e095f0d25289 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:09.558819 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-adf7e08d-e6d1-4842-b46f-e095f0d25289 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:09.559542 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-adf7e08d-e6d1-4842-b46f-e095f0d25289 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:09.561014 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-adf7e08d-e6d1-4842-b46f-e095f0d25289 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:09.561721 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-adf7e08d-e6d1-4842-b46f-e095f0d25289 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:09.563245 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-adf7e08d-e6d1-4842-b46f-e095f0d25289 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:09.713748 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-adf7e08d-e6d1-4842-b46f-e095f0d25289 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:09.722551 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-adf7e08d-e6d1-4842-b46f-e095f0d25289 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1370 microversion: 2.1 time: 0.180718 Sep 21 12:25:09.723121 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 287/565] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:09 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:25:09.768114 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-993396ee-8838-4314-8f3f-7dc7eb7eb3eb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:09.768733 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-993396ee-8838-4314-8f3f-7dc7eb7eb3eb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:09.776302 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-993396ee-8838-4314-8f3f-7dc7eb7eb3eb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:09.776799 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-993396ee-8838-4314-8f3f-7dc7eb7eb3eb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:09.777232 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-993396ee-8838-4314-8f3f-7dc7eb7eb3eb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:09.777965 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-993396ee-8838-4314-8f3f-7dc7eb7eb3eb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:09.778414 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-993396ee-8838-4314-8f3f-7dc7eb7eb3eb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:09.778831 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-993396ee-8838-4314-8f3f-7dc7eb7eb3eb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:09.951440 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-993396ee-8838-4314-8f3f-7dc7eb7eb3eb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:09.964325 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-993396ee-8838-4314-8f3f-7dc7eb7eb3eb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1722 microversion: 2.1 time: 0.200186 Sep 21 12:25:09.981141 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 279/566] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:09 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:25:10.493832 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-25784408-95cf-423a-ae9f-ab8a2699f8d9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:10.494840 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-25784408-95cf-423a-ae9f-ab8a2699f8d9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:10.502011 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-25784408-95cf-423a-ae9f-ab8a2699f8d9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:10.502639 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-25784408-95cf-423a-ae9f-ab8a2699f8d9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:10.503083 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-25784408-95cf-423a-ae9f-ab8a2699f8d9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:10.503995 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-25784408-95cf-423a-ae9f-ab8a2699f8d9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:10.504447 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-25784408-95cf-423a-ae9f-ab8a2699f8d9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:10.505039 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-25784408-95cf-423a-ae9f-ab8a2699f8d9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:10.645648 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-25784408-95cf-423a-ae9f-ab8a2699f8d9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:10.654694 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-25784408-95cf-423a-ae9f-ab8a2699f8d9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:10.656400 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-25784408-95cf-423a-ae9f-ab8a2699f8d9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:10.657914 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-25784408-95cf-423a-ae9f-ab8a2699f8d9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1741 microversion: 2.20 time: 0.168320 Sep 21 12:25:10.658692 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 288/567] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:10 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1741 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:10.745358 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-4f8ec467-b303-4f67-8ce6-5575a013c5a7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:10.746038 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-4f8ec467-b303-4f67-8ce6-5575a013c5a7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:10.753795 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4f8ec467-b303-4f67-8ce6-5575a013c5a7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:10.754550 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4f8ec467-b303-4f67-8ce6-5575a013c5a7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:10.755173 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4f8ec467-b303-4f67-8ce6-5575a013c5a7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:10.755940 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4f8ec467-b303-4f67-8ce6-5575a013c5a7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:10.756398 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4f8ec467-b303-4f67-8ce6-5575a013c5a7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:10.756821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4f8ec467-b303-4f67-8ce6-5575a013c5a7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:10.900326 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-4f8ec467-b303-4f67-8ce6-5575a013c5a7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:10.908506 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-4f8ec467-b303-4f67-8ce6-5575a013c5a7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1370 microversion: 2.1 time: 0.167284 Sep 21 12:25:10.909180 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 280/568] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:10 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:25:10.990782 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-c2863511-2289-485d-9099-70b7f664ee66 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:10.991412 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-c2863511-2289-485d-9099-70b7f664ee66 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:10.997890 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c2863511-2289-485d-9099-70b7f664ee66 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:10.998303 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c2863511-2289-485d-9099-70b7f664ee66 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:10.998749 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c2863511-2289-485d-9099-70b7f664ee66 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:11.000101 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c2863511-2289-485d-9099-70b7f664ee66 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:11.000555 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c2863511-2289-485d-9099-70b7f664ee66 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:11.001147 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c2863511-2289-485d-9099-70b7f664ee66 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:11.170778 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-c2863511-2289-485d-9099-70b7f664ee66 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:11.183992 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-c2863511-2289-485d-9099-70b7f664ee66 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1722 microversion: 2.1 time: 0.196982 Sep 21 12:25:11.185228 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 289/569] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:10 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:25:11.686429 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-1dd94ea3-d852-4256-8396-de7e66968f02 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:11.695341 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-1dd94ea3-d852-4256-8396-de7e66968f02 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:11.704130 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1dd94ea3-d852-4256-8396-de7e66968f02 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:11.708488 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1dd94ea3-d852-4256-8396-de7e66968f02 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:11.709142 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1dd94ea3-d852-4256-8396-de7e66968f02 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:11.710031 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1dd94ea3-d852-4256-8396-de7e66968f02 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:11.710708 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1dd94ea3-d852-4256-8396-de7e66968f02 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:11.714091 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1dd94ea3-d852-4256-8396-de7e66968f02 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:11.932756 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-d463874e-2288-43da-8d67-dd3b3cdf7766 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:11.933394 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-d463874e-2288-43da-8d67-dd3b3cdf7766 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:11.945246 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d463874e-2288-43da-8d67-dd3b3cdf7766 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:11.946058 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d463874e-2288-43da-8d67-dd3b3cdf7766 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:11.946505 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d463874e-2288-43da-8d67-dd3b3cdf7766 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:11.955882 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d463874e-2288-43da-8d67-dd3b3cdf7766 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:11.955882 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d463874e-2288-43da-8d67-dd3b3cdf7766 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:11.955882 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d463874e-2288-43da-8d67-dd3b3cdf7766 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:11.989281 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-1dd94ea3-d852-4256-8396-de7e66968f02 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:12.002353 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-1dd94ea3-d852-4256-8396-de7e66968f02 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:12.004293 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-1dd94ea3-d852-4256-8396-de7e66968f02 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:12.005823 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-1dd94ea3-d852-4256-8396-de7e66968f02 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1741 microversion: 2.20 time: 0.325871 Sep 21 12:25:12.007817 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 281/570] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:11 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1741 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:12.192721 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-d463874e-2288-43da-8d67-dd3b3cdf7766 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:12.201142 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-d463874e-2288-43da-8d67-dd3b3cdf7766 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1370 microversion: 2.1 time: 0.272657 Sep 21 12:25:12.201908 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 290/571] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:11 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1370 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:25:12.227930 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-fa279f32-28cd-4f89-965b-640058bb2b56 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:12.228539 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-fa279f32-28cd-4f89-965b-640058bb2b56 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:12.236106 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fa279f32-28cd-4f89-965b-640058bb2b56 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:12.236886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fa279f32-28cd-4f89-965b-640058bb2b56 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:12.237581 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fa279f32-28cd-4f89-965b-640058bb2b56 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:12.238469 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fa279f32-28cd-4f89-965b-640058bb2b56 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:12.239338 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fa279f32-28cd-4f89-965b-640058bb2b56 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:12.240082 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fa279f32-28cd-4f89-965b-640058bb2b56 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:12.404208 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-fa279f32-28cd-4f89-965b-640058bb2b56 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:12.414667 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-fa279f32-28cd-4f89-965b-640058bb2b56 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1722 microversion: 2.1 time: 0.190801 Sep 21 12:25:12.415477 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 282/572] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:12 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:25:13.033740 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-152ea0de-72ec-43f3-8636-108b2c2bc9d6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:13.034304 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-152ea0de-72ec-43f3-8636-108b2c2bc9d6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:13.041120 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-152ea0de-72ec-43f3-8636-108b2c2bc9d6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:13.041695 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-152ea0de-72ec-43f3-8636-108b2c2bc9d6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:13.042237 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-152ea0de-72ec-43f3-8636-108b2c2bc9d6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:13.043013 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-152ea0de-72ec-43f3-8636-108b2c2bc9d6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:13.043548 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-152ea0de-72ec-43f3-8636-108b2c2bc9d6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:13.044077 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-152ea0de-72ec-43f3-8636-108b2c2bc9d6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:13.231461 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-44caa28a-c9f8-4e14-af27-867c73654c82 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:13.232423 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-44caa28a-c9f8-4e14-af27-867c73654c82 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:13.240626 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-44caa28a-c9f8-4e14-af27-867c73654c82 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:13.241418 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-44caa28a-c9f8-4e14-af27-867c73654c82 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:13.242097 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-44caa28a-c9f8-4e14-af27-867c73654c82 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:13.243031 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-44caa28a-c9f8-4e14-af27-867c73654c82 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:13.243701 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-44caa28a-c9f8-4e14-af27-867c73654c82 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:13.244431 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-44caa28a-c9f8-4e14-af27-867c73654c82 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:13.263800 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-152ea0de-72ec-43f3-8636-108b2c2bc9d6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:13.277077 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-152ea0de-72ec-43f3-8636-108b2c2bc9d6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:13.284814 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-152ea0de-72ec-43f3-8636-108b2c2bc9d6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:13.286335 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-152ea0de-72ec-43f3-8636-108b2c2bc9d6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1741 microversion: 2.20 time: 0.258097 Sep 21 12:25:13.286923 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 291/573] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:13 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1741 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:13.436105 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-44caa28a-c9f8-4e14-af27-867c73654c82 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:13.450008 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-43c86323-08c8-4b40-a909-e8400e3d9c7f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:13.451073 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-43c86323-08c8-4b40-a909-e8400e3d9c7f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:13.451343 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-44caa28a-c9f8-4e14-af27-867c73654c82 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1370 microversion: 2.1 time: 0.225545 Sep 21 12:25:13.454174 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 283/574] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:13 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1370 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:25:13.463849 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-43c86323-08c8-4b40-a909-e8400e3d9c7f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:13.464349 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-43c86323-08c8-4b40-a909-e8400e3d9c7f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:13.464784 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-43c86323-08c8-4b40-a909-e8400e3d9c7f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:13.465563 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-43c86323-08c8-4b40-a909-e8400e3d9c7f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:13.466016 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-43c86323-08c8-4b40-a909-e8400e3d9c7f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:13.466439 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-43c86323-08c8-4b40-a909-e8400e3d9c7f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:13.635644 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-43c86323-08c8-4b40-a909-e8400e3d9c7f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:13.647460 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-43c86323-08c8-4b40-a909-e8400e3d9c7f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1722 microversion: 2.1 time: 0.205795 Sep 21 12:25:13.648765 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 292/575] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:13 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:25:14.325703 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-088cc6cf-df65-439b-af80-e7445197328a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:14.327050 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-088cc6cf-df65-439b-af80-e7445197328a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:14.334553 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-088cc6cf-df65-439b-af80-e7445197328a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:14.335140 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-088cc6cf-df65-439b-af80-e7445197328a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:14.335646 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-088cc6cf-df65-439b-af80-e7445197328a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:14.336494 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-088cc6cf-df65-439b-af80-e7445197328a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:14.337026 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-088cc6cf-df65-439b-af80-e7445197328a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:14.337687 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-088cc6cf-df65-439b-af80-e7445197328a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:14.358670 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=100 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:25:14.477259 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-57228e14-9392-447e-9572-ecebd238864d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:14.478005 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-57228e14-9392-447e-9572-ecebd238864d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:14.482130 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-088cc6cf-df65-439b-af80-e7445197328a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:14.485206 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-57228e14-9392-447e-9572-ecebd238864d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:14.485689 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-57228e14-9392-447e-9572-ecebd238864d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:14.486371 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-57228e14-9392-447e-9572-ecebd238864d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:14.487470 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-57228e14-9392-447e-9572-ecebd238864d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:14.488972 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-57228e14-9392-447e-9572-ecebd238864d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:14.489714 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-57228e14-9392-447e-9572-ecebd238864d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:14.498430 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-088cc6cf-df65-439b-af80-e7445197328a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:14.500663 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-088cc6cf-df65-439b-af80-e7445197328a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:14.501919 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-088cc6cf-df65-439b-af80-e7445197328a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1741 microversion: 2.20 time: 0.185017 Sep 21 12:25:14.502444 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 284/576] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:14 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1741 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:14.639968 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-57228e14-9392-447e-9572-ecebd238864d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:14.649158 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-57228e14-9392-447e-9572-ecebd238864d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1370 microversion: 2.1 time: 0.176134 Sep 21 12:25:14.650365 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 293/577] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:14 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:25:14.680093 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-ed3190dc-4819-4ddf-be55-e124eaecc06b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:14.681680 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-ed3190dc-4819-4ddf-be55-e124eaecc06b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:14.690273 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ed3190dc-4819-4ddf-be55-e124eaecc06b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:14.691132 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ed3190dc-4819-4ddf-be55-e124eaecc06b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:14.691844 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ed3190dc-4819-4ddf-be55-e124eaecc06b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:14.692865 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ed3190dc-4819-4ddf-be55-e124eaecc06b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:14.693716 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ed3190dc-4819-4ddf-be55-e124eaecc06b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:14.694639 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ed3190dc-4819-4ddf-be55-e124eaecc06b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:14.853044 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-ed3190dc-4819-4ddf-be55-e124eaecc06b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:14.864224 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-ed3190dc-4819-4ddf-be55-e124eaecc06b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1722 microversion: 2.1 time: 0.187587 Sep 21 12:25:14.869707 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-9ebeead3-c022-4b16-8c9c-eb24087fbf39 req-98094ff9-c42d-4a11-8521-8347022f23a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f4f10b5-8953-4c76-a286-6974d7c88433", "name": "network-vif-plugged", "status": "completed", "tag": "0b66debc-125c-4397-a41e-08b95892a114"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:25:14.876474 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 285/578] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:14 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:25:14.881541 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell0:SELECT=2 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:25:14.883884 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-9ebeead3-c022-4b16-8c9c-eb24087fbf39 req-98094ff9-c42d-4a11-8521-8347022f23a1 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:14.884581 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-9ebeead3-c022-4b16-8c9c-eb24087fbf39 req-98094ff9-c42d-4a11-8521-8347022f23a1 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:14.885181 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-9ebeead3-c022-4b16-8c9c-eb24087fbf39 req-98094ff9-c42d-4a11-8521-8347022f23a1 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:14.899636 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-9ebeead3-c022-4b16-8c9c-eb24087fbf39 req-98094ff9-c42d-4a11-8521-8347022f23a1 service nova] Creating event network-vif-plugged:0b66debc-125c-4397-a41e-08b95892a114 for instance 5f4f10b5-8953-4c76-a286-6974d7c88433 on hv-cinder-85867 Sep 21 12:25:14.906684 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-9ebeead3-c022-4b16-8c9c-eb24087fbf39 req-98094ff9-c42d-4a11-8521-8347022f23a1 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040896 Sep 21 12:25:14.907938 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 294/579] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:25:15.528520 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-dcd82866-c9cc-4c51-bc4c-375fccf1f664 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:15.529850 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-dcd82866-c9cc-4c51-bc4c-375fccf1f664 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:15.539289 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dcd82866-c9cc-4c51-bc4c-375fccf1f664 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:15.540264 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dcd82866-c9cc-4c51-bc4c-375fccf1f664 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:15.541046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dcd82866-c9cc-4c51-bc4c-375fccf1f664 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:15.541979 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dcd82866-c9cc-4c51-bc4c-375fccf1f664 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:15.542638 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dcd82866-c9cc-4c51-bc4c-375fccf1f664 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:15.543279 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dcd82866-c9cc-4c51-bc4c-375fccf1f664 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:15.675345 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-a4595a3e-23c0-48ad-bb7e-be6702202b65 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:15.676243 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-a4595a3e-23c0-48ad-bb7e-be6702202b65 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:15.678579 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell0:SELECT=12 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:25:15.680582 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:25:15.691860 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a4595a3e-23c0-48ad-bb7e-be6702202b65 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:15.692400 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a4595a3e-23c0-48ad-bb7e-be6702202b65 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:15.692854 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a4595a3e-23c0-48ad-bb7e-be6702202b65 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:15.693691 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a4595a3e-23c0-48ad-bb7e-be6702202b65 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:15.694340 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a4595a3e-23c0-48ad-bb7e-be6702202b65 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:15.702806 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-dcd82866-c9cc-4c51-bc4c-375fccf1f664 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:15.706210 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a4595a3e-23c0-48ad-bb7e-be6702202b65 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:15.712655 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-dcd82866-c9cc-4c51-bc4c-375fccf1f664 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:15.714097 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-dcd82866-c9cc-4c51-bc4c-375fccf1f664 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:15.715325 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-dcd82866-c9cc-4c51-bc4c-375fccf1f664 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1741 microversion: 2.20 time: 0.191200 Sep 21 12:25:15.724287 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 286/580] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:15 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1741 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:15.866601 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-a4595a3e-23c0-48ad-bb7e-be6702202b65 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:15.875020 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-a4595a3e-23c0-48ad-bb7e-be6702202b65 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1370 microversion: 2.1 time: 0.204784 Sep 21 12:25:15.875619 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 295/581] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:15 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1370 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:25:15.907930 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-d0a7577b-c997-4ab2-b13b-9f6dc3e05b83 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:15.908976 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-d0a7577b-c997-4ab2-b13b-9f6dc3e05b83 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:15.915222 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d0a7577b-c997-4ab2-b13b-9f6dc3e05b83 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:15.915571 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d0a7577b-c997-4ab2-b13b-9f6dc3e05b83 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:15.916038 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d0a7577b-c997-4ab2-b13b-9f6dc3e05b83 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:15.916916 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d0a7577b-c997-4ab2-b13b-9f6dc3e05b83 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:15.917584 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d0a7577b-c997-4ab2-b13b-9f6dc3e05b83 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:15.918015 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d0a7577b-c997-4ab2-b13b-9f6dc3e05b83 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:16.055424 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-d0a7577b-c997-4ab2-b13b-9f6dc3e05b83 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:16.065717 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-d0a7577b-c997-4ab2-b13b-9f6dc3e05b83 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1722 microversion: 2.1 time: 0.162013 Sep 21 12:25:16.066346 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 287/582] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:15 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:25:16.742068 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-484614af-694f-49e3-867d-911850946fe5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:16.742696 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-484614af-694f-49e3-867d-911850946fe5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:16.749782 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-484614af-694f-49e3-867d-911850946fe5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:16.750662 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-484614af-694f-49e3-867d-911850946fe5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:16.751330 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-484614af-694f-49e3-867d-911850946fe5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:16.752364 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-484614af-694f-49e3-867d-911850946fe5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:16.752929 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-484614af-694f-49e3-867d-911850946fe5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:16.753580 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-484614af-694f-49e3-867d-911850946fe5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:16.899555 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-843d94aa-5443-4671-b6c9-7fd8b4ea1405 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:16.901162 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-843d94aa-5443-4671-b6c9-7fd8b4ea1405 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:16.906933 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-484614af-694f-49e3-867d-911850946fe5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:16.907458 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell0:SELECT=2 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:25:16.911611 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-843d94aa-5443-4671-b6c9-7fd8b4ea1405 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:16.912673 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-843d94aa-5443-4671-b6c9-7fd8b4ea1405 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:16.913351 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-843d94aa-5443-4671-b6c9-7fd8b4ea1405 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:16.914837 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-843d94aa-5443-4671-b6c9-7fd8b4ea1405 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:16.915523 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-843d94aa-5443-4671-b6c9-7fd8b4ea1405 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:16.916196 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-843d94aa-5443-4671-b6c9-7fd8b4ea1405 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:16.916968 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-484614af-694f-49e3-867d-911850946fe5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:16.918455 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-484614af-694f-49e3-867d-911850946fe5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:16.919646 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-484614af-694f-49e3-867d-911850946fe5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1741 microversion: 2.20 time: 0.182960 Sep 21 12:25:16.920343 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 296/583] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:16 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1741 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:17.084384 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-843d94aa-5443-4671-b6c9-7fd8b4ea1405 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:17.089958 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-6231224a-ae85-45ce-a8e1-11d649e5dcba tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:17.100628 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-6231224a-ae85-45ce-a8e1-11d649e5dcba tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:17.114726 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6231224a-ae85-45ce-a8e1-11d649e5dcba tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:17.117219 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6231224a-ae85-45ce-a8e1-11d649e5dcba tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:17.120114 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6231224a-ae85-45ce-a8e1-11d649e5dcba tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:17.120717 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-843d94aa-5443-4671-b6c9-7fd8b4ea1405 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1370 microversion: 2.1 time: 0.226000 Sep 21 12:25:17.122331 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6231224a-ae85-45ce-a8e1-11d649e5dcba tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:17.123214 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6231224a-ae85-45ce-a8e1-11d649e5dcba tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:17.124085 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6231224a-ae85-45ce-a8e1-11d649e5dcba tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:17.127886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 288/584] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:16 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1370 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:25:17.285028 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-6231224a-ae85-45ce-a8e1-11d649e5dcba tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:17.300120 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-6231224a-ae85-45ce-a8e1-11d649e5dcba tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1699 microversion: 2.1 time: 0.213794 Sep 21 12:25:17.316070 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 297/585] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:17 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1699 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:25:17.325389 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-620d56f9-de53-49cd-95eb-ec016d9952b3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:25:17.336753 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-620d56f9-de53-49cd-95eb-ec016d9952b3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:17.337258 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-620d56f9-de53-49cd-95eb-ec016d9952b3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:17.337706 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-620d56f9-de53-49cd-95eb-ec016d9952b3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:17.363926 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-620d56f9-de53-49cd-95eb-ec016d9952b3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Going to try to start instance {{(pid=120463) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 21 12:25:17.411076 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-620d56f9-de53-49cd-95eb-ec016d9952b3 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "POST /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e/action" status: 202 len: 0 microversion: 2.1 time: 0.090668 Sep 21 12:25:17.411880 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 289/586] 10.222.0.71 () {60 vars in 1278 bytes} [Wed Sep 21 12:25:17 2022] POST /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 12:25:17.419643 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-b745ac4d-9d04-4372-8c3e-a2db2aa4769f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:17.420286 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-b745ac4d-9d04-4372-8c3e-a2db2aa4769f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:17.426853 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b745ac4d-9d04-4372-8c3e-a2db2aa4769f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:17.427340 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b745ac4d-9d04-4372-8c3e-a2db2aa4769f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:17.427790 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b745ac4d-9d04-4372-8c3e-a2db2aa4769f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:17.428497 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b745ac4d-9d04-4372-8c3e-a2db2aa4769f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:17.428950 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b745ac4d-9d04-4372-8c3e-a2db2aa4769f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:17.429374 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b745ac4d-9d04-4372-8c3e-a2db2aa4769f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:17.580758 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-b745ac4d-9d04-4372-8c3e-a2db2aa4769f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:17.594335 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-b745ac4d-9d04-4372-8c3e-a2db2aa4769f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1708 microversion: 2.1 time: 0.178388 Sep 21 12:25:17.599800 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 298/587] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:17 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1708 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:25:17.947738 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-1444fd3f-9005-4231-9306-09b43fb2fd1b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:17.948858 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-1444fd3f-9005-4231-9306-09b43fb2fd1b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:17.957661 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1444fd3f-9005-4231-9306-09b43fb2fd1b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:17.958637 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1444fd3f-9005-4231-9306-09b43fb2fd1b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:17.959094 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1444fd3f-9005-4231-9306-09b43fb2fd1b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:17.960592 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1444fd3f-9005-4231-9306-09b43fb2fd1b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:17.961230 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1444fd3f-9005-4231-9306-09b43fb2fd1b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:17.961667 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1444fd3f-9005-4231-9306-09b43fb2fd1b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:18.117245 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-1444fd3f-9005-4231-9306-09b43fb2fd1b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:18.131804 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-1444fd3f-9005-4231-9306-09b43fb2fd1b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:18.131804 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-1444fd3f-9005-4231-9306-09b43fb2fd1b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:18.131804 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-1444fd3f-9005-4231-9306-09b43fb2fd1b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1741 microversion: 2.20 time: 0.185654 Sep 21 12:25:18.132234 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 290/588] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:17 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1741 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:18.147161 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-f15547b0-dc47-4877-b5a2-af90c3487cde tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:18.147927 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-f15547b0-dc47-4877-b5a2-af90c3487cde tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:18.158472 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f15547b0-dc47-4877-b5a2-af90c3487cde tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:18.160455 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f15547b0-dc47-4877-b5a2-af90c3487cde tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:18.161273 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f15547b0-dc47-4877-b5a2-af90c3487cde tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:18.162328 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f15547b0-dc47-4877-b5a2-af90c3487cde tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:18.163229 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f15547b0-dc47-4877-b5a2-af90c3487cde tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:18.163687 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f15547b0-dc47-4877-b5a2-af90c3487cde tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:18.323395 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-f15547b0-dc47-4877-b5a2-af90c3487cde tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:18.331990 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-f15547b0-dc47-4877-b5a2-af90c3487cde tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1564 microversion: 2.1 time: 0.188966 Sep 21 12:25:18.332584 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 299/589] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:18 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1564 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:25:18.355559 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-044516e5-6962-4b82-9b50-22b59eb53dd6 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:18.356397 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-044516e5-6962-4b82-9b50-22b59eb53dd6 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:18.364764 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-044516e5-6962-4b82-9b50-22b59eb53dd6 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:18.365528 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-044516e5-6962-4b82-9b50-22b59eb53dd6 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:18.366151 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-044516e5-6962-4b82-9b50-22b59eb53dd6 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:18.367026 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-044516e5-6962-4b82-9b50-22b59eb53dd6 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:18.367637 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-044516e5-6962-4b82-9b50-22b59eb53dd6 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:18.368249 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-044516e5-6962-4b82-9b50-22b59eb53dd6 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:18.491487 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-044516e5-6962-4b82-9b50-22b59eb53dd6 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.139606 Sep 21 12:25:18.493401 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 291/590] 10.222.0.71 () {58 vars in 1275 bytes} [Wed Sep 21 12:25:18 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 12:25:18.620115 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-12d8b4c6-e3b2-4648-9ea6-df074060a208 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:18.620816 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-12d8b4c6-e3b2-4648-9ea6-df074060a208 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:18.629646 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-12d8b4c6-e3b2-4648-9ea6-df074060a208 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:18.630229 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-12d8b4c6-e3b2-4648-9ea6-df074060a208 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:18.630721 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-12d8b4c6-e3b2-4648-9ea6-df074060a208 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:18.631524 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-12d8b4c6-e3b2-4648-9ea6-df074060a208 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:18.632084 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-12d8b4c6-e3b2-4648-9ea6-df074060a208 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:18.632525 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-12d8b4c6-e3b2-4648-9ea6-df074060a208 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:18.638154 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:25:18.923102 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-12d8b4c6-e3b2-4648-9ea6-df074060a208 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:18.934006 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-12d8b4c6-e3b2-4648-9ea6-df074060a208 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1708 microversion: 2.1 time: 0.317839 Sep 21 12:25:18.950156 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 300/591] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:18 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1708 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:25:19.170055 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-bcb52661-eef6-4aad-ad31-518c4bf4f8b6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:19.171355 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-bcb52661-eef6-4aad-ad31-518c4bf4f8b6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:19.177868 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bcb52661-eef6-4aad-ad31-518c4bf4f8b6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:19.178436 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bcb52661-eef6-4aad-ad31-518c4bf4f8b6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:19.178953 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bcb52661-eef6-4aad-ad31-518c4bf4f8b6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:19.179651 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bcb52661-eef6-4aad-ad31-518c4bf4f8b6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:19.180144 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bcb52661-eef6-4aad-ad31-518c4bf4f8b6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:19.180609 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bcb52661-eef6-4aad-ad31-518c4bf4f8b6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:19.317882 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-bcb52661-eef6-4aad-ad31-518c4bf4f8b6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:19.326185 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-bcb52661-eef6-4aad-ad31-518c4bf4f8b6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:19.327648 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-bcb52661-eef6-4aad-ad31-518c4bf4f8b6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:19.329114 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-bcb52661-eef6-4aad-ad31-518c4bf4f8b6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1741 microversion: 2.20 time: 0.163566 Sep 21 12:25:19.329686 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 292/592] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:19 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1741 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:19.810923 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-a6229e6c-377f-473b-82d8-ab19cc44493c tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:19.811610 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-a6229e6c-377f-473b-82d8-ab19cc44493c tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:19.817816 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a6229e6c-377f-473b-82d8-ab19cc44493c tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:19.818308 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a6229e6c-377f-473b-82d8-ab19cc44493c tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:19.818751 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a6229e6c-377f-473b-82d8-ab19cc44493c tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:19.819457 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a6229e6c-377f-473b-82d8-ab19cc44493c tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:19.819946 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a6229e6c-377f-473b-82d8-ab19cc44493c tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:19.820379 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a6229e6c-377f-473b-82d8-ab19cc44493c tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:19.959379 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-b569964c-f92e-41d9-83cf-e9ddeead42ec tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:19.960016 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-b569964c-f92e-41d9-83cf-e9ddeead42ec tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:19.966119 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b569964c-f92e-41d9-83cf-e9ddeead42ec tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:19.966673 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b569964c-f92e-41d9-83cf-e9ddeead42ec tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:19.967126 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b569964c-f92e-41d9-83cf-e9ddeead42ec tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:19.968991 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b569964c-f92e-41d9-83cf-e9ddeead42ec tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:19.968991 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b569964c-f92e-41d9-83cf-e9ddeead42ec tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:19.969346 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b569964c-f92e-41d9-83cf-e9ddeead42ec tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:20.074593 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-a6229e6c-377f-473b-82d8-ab19cc44493c tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:20.099116 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-a6229e6c-377f-473b-82d8-ab19cc44493c tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1593 microversion: 2.1 time: 0.291874 Sep 21 12:25:20.103393 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 301/593] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:19 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1593 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:25:20.123386 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-b569964c-f92e-41d9-83cf-e9ddeead42ec tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:20.133913 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-b569964c-f92e-41d9-83cf-e9ddeead42ec tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1708 microversion: 2.1 time: 0.178449 Sep 21 12:25:20.134761 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 293/594] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:19 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1708 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:25:20.358065 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-29472fe7-3158-454a-970e-e7a8eda9c5a2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:20.359956 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-29472fe7-3158-454a-970e-e7a8eda9c5a2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:20.366098 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-29472fe7-3158-454a-970e-e7a8eda9c5a2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:20.366592 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-29472fe7-3158-454a-970e-e7a8eda9c5a2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:20.367042 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-29472fe7-3158-454a-970e-e7a8eda9c5a2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:20.367778 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-29472fe7-3158-454a-970e-e7a8eda9c5a2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:20.368252 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-29472fe7-3158-454a-970e-e7a8eda9c5a2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:20.368678 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-29472fe7-3158-454a-970e-e7a8eda9c5a2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:20.898282 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-03cb7d0a-ee52-4d57-9dc8-2fc72168772f req-5cfb968c-1e33-438f-afe4-86667d9b5640 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f4f10b5-8953-4c76-a286-6974d7c88433", "tag": "0b66debc-125c-4397-a41e-08b95892a114"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:25:20.910482 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-03cb7d0a-ee52-4d57-9dc8-2fc72168772f req-5cfb968c-1e33-438f-afe4-86667d9b5640 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:20.911371 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-03cb7d0a-ee52-4d57-9dc8-2fc72168772f req-5cfb968c-1e33-438f-afe4-86667d9b5640 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:20.912072 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-03cb7d0a-ee52-4d57-9dc8-2fc72168772f req-5cfb968c-1e33-438f-afe4-86667d9b5640 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:20.927082 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-03cb7d0a-ee52-4d57-9dc8-2fc72168772f req-5cfb968c-1e33-438f-afe4-86667d9b5640 service nova] Creating event network-changed:0b66debc-125c-4397-a41e-08b95892a114 for instance 5f4f10b5-8953-4c76-a286-6974d7c88433 on hv-cinder-85867 Sep 21 12:25:20.932766 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-03cb7d0a-ee52-4d57-9dc8-2fc72168772f req-5cfb968c-1e33-438f-afe4-86667d9b5640 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038135 Sep 21 12:25:20.934408 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 294/595] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 12:25:20.957051 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-29472fe7-3158-454a-970e-e7a8eda9c5a2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:20.966806 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-29472fe7-3158-454a-970e-e7a8eda9c5a2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:20.969469 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-29472fe7-3158-454a-970e-e7a8eda9c5a2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:20.970950 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-29472fe7-3158-454a-970e-e7a8eda9c5a2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1723 microversion: 2.20 time: 0.618922 Sep 21 12:25:20.982677 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 302/596] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:20 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1723 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:21.159785 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-b0b96877-db93-4979-8996-157f32e5a109 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:21.161690 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-b0b96877-db93-4979-8996-157f32e5a109 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:21.167979 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b0b96877-db93-4979-8996-157f32e5a109 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:21.168473 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b0b96877-db93-4979-8996-157f32e5a109 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:21.168912 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b0b96877-db93-4979-8996-157f32e5a109 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:21.169619 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b0b96877-db93-4979-8996-157f32e5a109 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:21.170074 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b0b96877-db93-4979-8996-157f32e5a109 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:21.170503 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b0b96877-db93-4979-8996-157f32e5a109 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:21.575298 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-b0b96877-db93-4979-8996-157f32e5a109 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:21.585103 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-b0b96877-db93-4979-8996-157f32e5a109 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1708 microversion: 2.1 time: 0.430605 Sep 21 12:25:21.585699 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 295/597] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:21 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1708 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:25:21.997912 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-7d77f012-fff2-42b1-8e87-c9c4d88a89a7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:21.998726 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-7d77f012-fff2-42b1-8e87-c9c4d88a89a7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:22.005819 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7d77f012-fff2-42b1-8e87-c9c4d88a89a7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:22.006388 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7d77f012-fff2-42b1-8e87-c9c4d88a89a7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:22.006900 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7d77f012-fff2-42b1-8e87-c9c4d88a89a7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:22.007681 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7d77f012-fff2-42b1-8e87-c9c4d88a89a7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:22.009977 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7d77f012-fff2-42b1-8e87-c9c4d88a89a7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:22.009977 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7d77f012-fff2-42b1-8e87-c9c4d88a89a7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:22.148909 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-7d77f012-fff2-42b1-8e87-c9c4d88a89a7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:22.157842 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-7d77f012-fff2-42b1-8e87-c9c4d88a89a7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:22.159292 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-7d77f012-fff2-42b1-8e87-c9c4d88a89a7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:22.160499 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-7d77f012-fff2-42b1-8e87-c9c4d88a89a7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1723 microversion: 2.20 time: 0.166639 Sep 21 12:25:22.161065 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 303/598] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:21 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:22.260170 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-9fe3a5cd-4a58-4c22-8667-c85d390227d1 req-675595db-1fea-4bd1-af0b-f2abd8876a4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cc8e107-efaf-4689-9e8f-f8adc955c6d9", "tag": "2d86ac1e-8e22-4863-a099-2f5b0b120e07"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:25:22.270804 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-9fe3a5cd-4a58-4c22-8667-c85d390227d1 req-675595db-1fea-4bd1-af0b-f2abd8876a4b service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:22.271282 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-9fe3a5cd-4a58-4c22-8667-c85d390227d1 req-675595db-1fea-4bd1-af0b-f2abd8876a4b service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:22.271712 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-9fe3a5cd-4a58-4c22-8667-c85d390227d1 req-675595db-1fea-4bd1-af0b-f2abd8876a4b service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:22.284198 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-9fe3a5cd-4a58-4c22-8667-c85d390227d1 req-675595db-1fea-4bd1-af0b-f2abd8876a4b service nova] Creating event network-changed:2d86ac1e-8e22-4863-a099-2f5b0b120e07 for instance 3cc8e107-efaf-4689-9e8f-f8adc955c6d9 on hv-cinder-85867 Sep 21 12:25:22.289487 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-9fe3a5cd-4a58-4c22-8667-c85d390227d1 req-675595db-1fea-4bd1-af0b-f2abd8876a4b service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032852 Sep 21 12:25:22.290496 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 296/599] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:25:22.612765 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-72cdb949-33a5-483c-8603-77d7fd0e1e62 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:22.614099 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-72cdb949-33a5-483c-8603-77d7fd0e1e62 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:22.623420 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-72cdb949-33a5-483c-8603-77d7fd0e1e62 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:22.624344 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-72cdb949-33a5-483c-8603-77d7fd0e1e62 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:22.624962 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-72cdb949-33a5-483c-8603-77d7fd0e1e62 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:22.626710 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-72cdb949-33a5-483c-8603-77d7fd0e1e62 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:22.627335 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-72cdb949-33a5-483c-8603-77d7fd0e1e62 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:22.627924 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-72cdb949-33a5-483c-8603-77d7fd0e1e62 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:22.832739 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-72cdb949-33a5-483c-8603-77d7fd0e1e62 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:22.841949 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-72cdb949-33a5-483c-8603-77d7fd0e1e62 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1708 microversion: 2.1 time: 0.235038 Sep 21 12:25:22.843196 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 304/600] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:22 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1708 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:25:22.872917 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-81822bb0-9270-4b06-ae4f-24307ee739f8 req-f6ba5dda-ece2-43a6-9b1e-6b82734603fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e9ebd08-4c95-43f6-a1a4-3268532d961e", "name": "network-vif-unplugged", "status": "completed", "tag": "1f39c2aa-a245-4b77-8233-20f0c6c6cb30"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:25:22.884758 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-81822bb0-9270-4b06-ae4f-24307ee739f8 req-f6ba5dda-ece2-43a6-9b1e-6b82734603fe service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:22.885242 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-81822bb0-9270-4b06-ae4f-24307ee739f8 req-f6ba5dda-ece2-43a6-9b1e-6b82734603fe service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:22.885683 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-81822bb0-9270-4b06-ae4f-24307ee739f8 req-f6ba5dda-ece2-43a6-9b1e-6b82734603fe service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:22.903212 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-81822bb0-9270-4b06-ae4f-24307ee739f8 req-f6ba5dda-ece2-43a6-9b1e-6b82734603fe service nova] Creating event network-vif-unplugged:1f39c2aa-a245-4b77-8233-20f0c6c6cb30 for instance 5e9ebd08-4c95-43f6-a1a4-3268532d961e on hv-cinder-85867 Sep 21 12:25:22.911500 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-81822bb0-9270-4b06-ae4f-24307ee739f8 req-f6ba5dda-ece2-43a6-9b1e-6b82734603fe service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042768 Sep 21 12:25:22.912233 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 297/601] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:25:23.185697 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-ea0c1ec4-922d-4a80-a780-70c8a6237391 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:23.187186 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-ea0c1ec4-922d-4a80-a780-70c8a6237391 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:23.194481 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ea0c1ec4-922d-4a80-a780-70c8a6237391 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:23.195022 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ea0c1ec4-922d-4a80-a780-70c8a6237391 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:23.195467 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ea0c1ec4-922d-4a80-a780-70c8a6237391 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:23.196237 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ea0c1ec4-922d-4a80-a780-70c8a6237391 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:23.196726 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ea0c1ec4-922d-4a80-a780-70c8a6237391 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:23.197351 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ea0c1ec4-922d-4a80-a780-70c8a6237391 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:23.247801 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-368fb75a-9f58-47cd-9ed2-e5d94fa05c72 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-427883083"}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:25:23.248421 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-368fb75a-9f58-47cd-9ed2-e5d94fa05c72 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:23.250650 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=100 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:25:23.256360 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-368fb75a-9f58-47cd-9ed2-e5d94fa05c72 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:23.257071 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-368fb75a-9f58-47cd-9ed2-e5d94fa05c72 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:23.257715 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-368fb75a-9f58-47cd-9ed2-e5d94fa05c72 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:23.258427 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-368fb75a-9f58-47cd-9ed2-e5d94fa05c72 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:23.258889 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-368fb75a-9f58-47cd-9ed2-e5d94fa05c72 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:23.259636 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-368fb75a-9f58-47cd-9ed2-e5d94fa05c72 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:23.353466 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-ea0c1ec4-922d-4a80-a780-70c8a6237391 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:23.363074 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-ea0c1ec4-922d-4a80-a780-70c8a6237391 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:23.364867 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-ea0c1ec4-922d-4a80-a780-70c8a6237391 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:23.366086 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-ea0c1ec4-922d-4a80-a780-70c8a6237391 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1723 microversion: 2.20 time: 0.184889 Sep 21 12:25:23.366649 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 305/602] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:23 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:23.399128 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.network.security_group_api [None req-368fb75a-9f58-47cd-9ed2-e5d94fa05c72 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Adding security group 9eb76a99-7f85-4224-b0ee-48e3952ae20b to port 2d86ac1e-8e22-4863-a099-2f5b0b120e07 Sep 21 12:25:23.772939 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-368fb75a-9f58-47cd-9ed2-e5d94fa05c72 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "POST /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9/action" status: 202 len: 0 microversion: 2.1 time: 0.529498 Sep 21 12:25:23.773559 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 298/603] 10.222.0.71 () {60 vars in 1278 bytes} [Wed Sep 21 12:25:23 2022] POST /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 12:25:23.782214 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-aec9ba12-990b-45c9-8195-8cf707044699 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:23.782954 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-aec9ba12-990b-45c9-8195-8cf707044699 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:23.789310 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-aec9ba12-990b-45c9-8195-8cf707044699 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:23.789803 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-aec9ba12-990b-45c9-8195-8cf707044699 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:23.790245 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-aec9ba12-990b-45c9-8195-8cf707044699 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:23.790951 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-aec9ba12-990b-45c9-8195-8cf707044699 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:23.791445 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-aec9ba12-990b-45c9-8195-8cf707044699 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:23.792150 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-aec9ba12-990b-45c9-8195-8cf707044699 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:23.867824 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-17f161e7-2bb7-4bf6-b036-3e3fd8bf019b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:23.868770 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-17f161e7-2bb7-4bf6-b036-3e3fd8bf019b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:23.877628 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-17f161e7-2bb7-4bf6-b036-3e3fd8bf019b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:23.878494 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-17f161e7-2bb7-4bf6-b036-3e3fd8bf019b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:23.878942 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-17f161e7-2bb7-4bf6-b036-3e3fd8bf019b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:23.879661 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-17f161e7-2bb7-4bf6-b036-3e3fd8bf019b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:23.880314 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-17f161e7-2bb7-4bf6-b036-3e3fd8bf019b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:23.880749 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-17f161e7-2bb7-4bf6-b036-3e3fd8bf019b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:23.949821 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-aec9ba12-990b-45c9-8195-8cf707044699 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:23.959121 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-aec9ba12-990b-45c9-8195-8cf707044699 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1639 microversion: 2.1 time: 0.181391 Sep 21 12:25:23.959849 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 306/604] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:23 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1639 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:25:24.024061 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-17f161e7-2bb7-4bf6-b036-3e3fd8bf019b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:24.032500 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-17f161e7-2bb7-4bf6-b036-3e3fd8bf019b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1712 microversion: 2.1 time: 0.169873 Sep 21 12:25:24.033084 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 299/605] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:25:23 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1712 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:25:24.304309 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-e43b06ca-ba57-4731-9264-1b3916ec78b9 req-c699e35a-cbfa-4911-a403-c9296bc0a441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cc8e107-efaf-4689-9e8f-f8adc955c6d9", "tag": "2d86ac1e-8e22-4863-a099-2f5b0b120e07"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:25:24.314741 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-e43b06ca-ba57-4731-9264-1b3916ec78b9 req-c699e35a-cbfa-4911-a403-c9296bc0a441 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:24.315211 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-e43b06ca-ba57-4731-9264-1b3916ec78b9 req-c699e35a-cbfa-4911-a403-c9296bc0a441 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:24.315639 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-e43b06ca-ba57-4731-9264-1b3916ec78b9 req-c699e35a-cbfa-4911-a403-c9296bc0a441 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:24.326927 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-e43b06ca-ba57-4731-9264-1b3916ec78b9 req-c699e35a-cbfa-4911-a403-c9296bc0a441 service nova] Creating event network-changed:2d86ac1e-8e22-4863-a099-2f5b0b120e07 for instance 3cc8e107-efaf-4689-9e8f-f8adc955c6d9 on hv-cinder-85867 Sep 21 12:25:24.332787 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-e43b06ca-ba57-4731-9264-1b3916ec78b9 req-c699e35a-cbfa-4911-a403-c9296bc0a441 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032038 Sep 21 12:25:24.333383 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 307/606] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:25:24.391741 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-5ae51300-ded5-49f4-89db-8cad08f135f7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:24.392304 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-5ae51300-ded5-49f4-89db-8cad08f135f7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:24.398908 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5ae51300-ded5-49f4-89db-8cad08f135f7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:24.399403 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5ae51300-ded5-49f4-89db-8cad08f135f7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:24.399979 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5ae51300-ded5-49f4-89db-8cad08f135f7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:24.400612 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5ae51300-ded5-49f4-89db-8cad08f135f7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:24.401072 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5ae51300-ded5-49f4-89db-8cad08f135f7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:24.401613 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5ae51300-ded5-49f4-89db-8cad08f135f7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:24.535566 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-5ae51300-ded5-49f4-89db-8cad08f135f7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:24.543581 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-5ae51300-ded5-49f4-89db-8cad08f135f7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:24.545062 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-5ae51300-ded5-49f4-89db-8cad08f135f7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:24.546781 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-5ae51300-ded5-49f4-89db-8cad08f135f7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1723 microversion: 2.20 time: 0.159154 Sep 21 12:25:24.547346 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 300/607] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:24 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:25.574594 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-20ce76a3-9976-4bae-9946-c1838b20865e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:25.575336 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-20ce76a3-9976-4bae-9946-c1838b20865e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:25.582162 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-20ce76a3-9976-4bae-9946-c1838b20865e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:25.582657 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-20ce76a3-9976-4bae-9946-c1838b20865e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:25.583098 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-20ce76a3-9976-4bae-9946-c1838b20865e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:25.583914 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-20ce76a3-9976-4bae-9946-c1838b20865e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:25.584383 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-20ce76a3-9976-4bae-9946-c1838b20865e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:25.584815 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-20ce76a3-9976-4bae-9946-c1838b20865e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:25.724681 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-20ce76a3-9976-4bae-9946-c1838b20865e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:25.732787 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-20ce76a3-9976-4bae-9946-c1838b20865e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:25.734268 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-20ce76a3-9976-4bae-9946-c1838b20865e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:25.735426 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-20ce76a3-9976-4bae-9946-c1838b20865e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1726 microversion: 2.20 time: 0.166467 Sep 21 12:25:25.736026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 308/608] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:25 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:25:25.760335 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-177b6a83-cf93-4f18-8a81-a004d39635dd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "935e185f-4654-4eff-98f6-ae976c584203"}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:25:25.762935 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-177b6a83-cf93-4f18-8a81-a004d39635dd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:25.770165 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-177b6a83-cf93-4f18-8a81-a004d39635dd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:25.770650 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-177b6a83-cf93-4f18-8a81-a004d39635dd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:25.771088 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-177b6a83-cf93-4f18-8a81-a004d39635dd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:25.771802 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-177b6a83-cf93-4f18-8a81-a004d39635dd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:25.772262 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-177b6a83-cf93-4f18-8a81-a004d39635dd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:25.772696 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-177b6a83-cf93-4f18-8a81-a004d39635dd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:25.955417 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:25:26.068634 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-177b6a83-cf93-4f18-8a81-a004d39635dd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "POST /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.312311 Sep 21 12:25:26.069328 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 301/609] 10.222.0.71 () {62 vars in 1364 bytes} [Wed Sep 21 12:25:25 2022] POST /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e/os-volume_attachments => generated 188 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 12:25:26.199646 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-bcfda48c-82ee-40c6-87b5-0760b25dde77 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:25:26.200267 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-bcfda48c-82ee-40c6-87b5-0760b25dde77 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:26.206582 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bcfda48c-82ee-40c6-87b5-0760b25dde77 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:26.207067 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bcfda48c-82ee-40c6-87b5-0760b25dde77 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:26.207500 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bcfda48c-82ee-40c6-87b5-0760b25dde77 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:26.208216 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bcfda48c-82ee-40c6-87b5-0760b25dde77 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:26.208670 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bcfda48c-82ee-40c6-87b5-0760b25dde77 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:26.209091 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bcfda48c-82ee-40c6-87b5-0760b25dde77 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:26.252283 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-bcfda48c-82ee-40c6-87b5-0760b25dde77 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120462) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 21 12:25:26.321724 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-bcfda48c-82ee-40c6-87b5-0760b25dde77 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "POST /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e/action" status: 202 len: 0 microversion: 2.20 time: 0.125919 Sep 21 12:25:26.322967 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 309/610] 10.222.0.71 () {62 vars in 1319 bytes} [Wed Sep 21 12:25:26 2022] POST /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 21 12:25:26.333020 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-c9bbfe12-43db-4591-8e4e-641fa4feb74a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:26.333721 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-c9bbfe12-43db-4591-8e4e-641fa4feb74a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:26.342138 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c9bbfe12-43db-4591-8e4e-641fa4feb74a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:26.343219 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c9bbfe12-43db-4591-8e4e-641fa4feb74a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:26.343863 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c9bbfe12-43db-4591-8e4e-641fa4feb74a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:26.344795 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c9bbfe12-43db-4591-8e4e-641fa4feb74a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:26.345441 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c9bbfe12-43db-4591-8e4e-641fa4feb74a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:26.346051 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c9bbfe12-43db-4591-8e4e-641fa4feb74a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:26.486652 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-c9bbfe12-43db-4591-8e4e-641fa4feb74a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:26.496105 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-c9bbfe12-43db-4591-8e4e-641fa4feb74a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:26.497733 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-c9bbfe12-43db-4591-8e4e-641fa4feb74a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:26.498930 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-c9bbfe12-43db-4591-8e4e-641fa4feb74a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1752 microversion: 2.20 time: 0.170003 Sep 21 12:25:26.512164 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 302/611] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:26 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1752 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:25:27.525727 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-7e053296-29ba-4f12-b1d4-ff0673018274 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:27.526355 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-7e053296-29ba-4f12-b1d4-ff0673018274 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:27.533420 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7e053296-29ba-4f12-b1d4-ff0673018274 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:27.533909 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7e053296-29ba-4f12-b1d4-ff0673018274 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:27.534348 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7e053296-29ba-4f12-b1d4-ff0673018274 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:27.535040 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7e053296-29ba-4f12-b1d4-ff0673018274 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:27.535494 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7e053296-29ba-4f12-b1d4-ff0673018274 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:27.535962 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7e053296-29ba-4f12-b1d4-ff0673018274 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:27.672379 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-7e053296-29ba-4f12-b1d4-ff0673018274 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:27.681141 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-7e053296-29ba-4f12-b1d4-ff0673018274 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:27.682689 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-7e053296-29ba-4f12-b1d4-ff0673018274 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:27.683955 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-7e053296-29ba-4f12-b1d4-ff0673018274 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1754 microversion: 2.20 time: 0.162220 Sep 21 12:25:27.684470 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 310/612] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:27 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:28.710033 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-07b52a56-dc70-4073-b21f-aec4c6f64736 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:28.710648 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-07b52a56-dc70-4073-b21f-aec4c6f64736 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:28.717864 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-07b52a56-dc70-4073-b21f-aec4c6f64736 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:28.718286 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-07b52a56-dc70-4073-b21f-aec4c6f64736 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:28.718732 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-07b52a56-dc70-4073-b21f-aec4c6f64736 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:28.719420 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-07b52a56-dc70-4073-b21f-aec4c6f64736 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:28.719916 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-07b52a56-dc70-4073-b21f-aec4c6f64736 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:28.720352 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-07b52a56-dc70-4073-b21f-aec4c6f64736 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:28.849361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-07b52a56-dc70-4073-b21f-aec4c6f64736 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:28.858086 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-07b52a56-dc70-4073-b21f-aec4c6f64736 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:28.859570 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-07b52a56-dc70-4073-b21f-aec4c6f64736 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:28.862806 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-07b52a56-dc70-4073-b21f-aec4c6f64736 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1810 microversion: 2.20 time: 0.154818 Sep 21 12:25:28.863408 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 303/613] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:28 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:29.893242 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-3990ec0e-e1e7-455a-98ae-31e6046e6495 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:29.893892 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-3990ec0e-e1e7-455a-98ae-31e6046e6495 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:29.900339 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3990ec0e-e1e7-455a-98ae-31e6046e6495 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:29.900827 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3990ec0e-e1e7-455a-98ae-31e6046e6495 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:29.901265 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3990ec0e-e1e7-455a-98ae-31e6046e6495 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:29.901966 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3990ec0e-e1e7-455a-98ae-31e6046e6495 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:29.902591 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3990ec0e-e1e7-455a-98ae-31e6046e6495 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:29.902833 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3990ec0e-e1e7-455a-98ae-31e6046e6495 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:30.041536 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-3990ec0e-e1e7-455a-98ae-31e6046e6495 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:30.051249 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-3990ec0e-e1e7-455a-98ae-31e6046e6495 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:30.053851 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-3990ec0e-e1e7-455a-98ae-31e6046e6495 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:30.055090 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-3990ec0e-e1e7-455a-98ae-31e6046e6495 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1810 microversion: 2.20 time: 0.165727 Sep 21 12:25:30.056315 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 311/614] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:29 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:31.082071 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-a26b3656-0db0-4b0b-bb3c-352045a86994 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:31.082785 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-a26b3656-0db0-4b0b-bb3c-352045a86994 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:31.089464 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a26b3656-0db0-4b0b-bb3c-352045a86994 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:31.089955 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a26b3656-0db0-4b0b-bb3c-352045a86994 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:31.090398 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a26b3656-0db0-4b0b-bb3c-352045a86994 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:31.091102 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a26b3656-0db0-4b0b-bb3c-352045a86994 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:31.091569 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a26b3656-0db0-4b0b-bb3c-352045a86994 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:31.092040 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a26b3656-0db0-4b0b-bb3c-352045a86994 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:31.225193 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a26b3656-0db0-4b0b-bb3c-352045a86994 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:31.234780 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a26b3656-0db0-4b0b-bb3c-352045a86994 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:31.236590 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a26b3656-0db0-4b0b-bb3c-352045a86994 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:31.237676 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-a26b3656-0db0-4b0b-bb3c-352045a86994 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1810 microversion: 2.20 time: 0.159924 Sep 21 12:25:31.238263 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 304/615] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:31 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:32.262505 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-7fe1fbc6-14ee-49fd-9b17-4779120a126e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:32.263110 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-7fe1fbc6-14ee-49fd-9b17-4779120a126e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:32.269665 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7fe1fbc6-14ee-49fd-9b17-4779120a126e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:32.270139 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7fe1fbc6-14ee-49fd-9b17-4779120a126e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:32.270570 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7fe1fbc6-14ee-49fd-9b17-4779120a126e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:32.271270 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7fe1fbc6-14ee-49fd-9b17-4779120a126e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:32.271714 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7fe1fbc6-14ee-49fd-9b17-4779120a126e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:32.272162 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7fe1fbc6-14ee-49fd-9b17-4779120a126e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:32.409525 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-7fe1fbc6-14ee-49fd-9b17-4779120a126e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:32.418369 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-7fe1fbc6-14ee-49fd-9b17-4779120a126e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:32.419838 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-7fe1fbc6-14ee-49fd-9b17-4779120a126e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:32.421618 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-7fe1fbc6-14ee-49fd-9b17-4779120a126e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1810 microversion: 2.20 time: 0.163044 Sep 21 12:25:32.422173 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 312/616] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:32 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:33.446438 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-b5835e39-362e-4d47-9968-7aecf9411657 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:33.447233 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-b5835e39-362e-4d47-9968-7aecf9411657 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:33.454579 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b5835e39-362e-4d47-9968-7aecf9411657 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:33.455063 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b5835e39-362e-4d47-9968-7aecf9411657 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:33.455496 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b5835e39-362e-4d47-9968-7aecf9411657 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:33.456221 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b5835e39-362e-4d47-9968-7aecf9411657 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:33.456672 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b5835e39-362e-4d47-9968-7aecf9411657 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:33.457236 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b5835e39-362e-4d47-9968-7aecf9411657 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:33.595610 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-b5835e39-362e-4d47-9968-7aecf9411657 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:33.604843 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-b5835e39-362e-4d47-9968-7aecf9411657 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:33.606292 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-b5835e39-362e-4d47-9968-7aecf9411657 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:33.607531 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-b5835e39-362e-4d47-9968-7aecf9411657 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1810 microversion: 2.20 time: 0.164891 Sep 21 12:25:33.608206 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 305/617] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:33 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:25:34.633518 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-c1e3c696-80d6-4829-83ba-96dec4fb0c24 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:34.634252 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-c1e3c696-80d6-4829-83ba-96dec4fb0c24 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:34.641060 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c1e3c696-80d6-4829-83ba-96dec4fb0c24 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:34.641552 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c1e3c696-80d6-4829-83ba-96dec4fb0c24 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:34.642041 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c1e3c696-80d6-4829-83ba-96dec4fb0c24 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:34.642754 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c1e3c696-80d6-4829-83ba-96dec4fb0c24 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:34.643217 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c1e3c696-80d6-4829-83ba-96dec4fb0c24 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:34.643648 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c1e3c696-80d6-4829-83ba-96dec4fb0c24 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:34.781083 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-c1e3c696-80d6-4829-83ba-96dec4fb0c24 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:34.790174 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-c1e3c696-80d6-4829-83ba-96dec4fb0c24 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:34.791627 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-c1e3c696-80d6-4829-83ba-96dec4fb0c24 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:34.792828 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-c1e3c696-80d6-4829-83ba-96dec4fb0c24 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1810 microversion: 2.20 time: 0.163291 Sep 21 12:25:34.793644 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 313/618] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:34 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:35.819323 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-6a41c8da-9799-4711-ba38-8ac0dfc02014 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:35.820048 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-6a41c8da-9799-4711-ba38-8ac0dfc02014 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:35.827730 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6a41c8da-9799-4711-ba38-8ac0dfc02014 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:35.828639 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6a41c8da-9799-4711-ba38-8ac0dfc02014 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:35.829156 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6a41c8da-9799-4711-ba38-8ac0dfc02014 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:35.829944 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6a41c8da-9799-4711-ba38-8ac0dfc02014 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:35.830406 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6a41c8da-9799-4711-ba38-8ac0dfc02014 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:35.830834 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6a41c8da-9799-4711-ba38-8ac0dfc02014 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:35.966299 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-6a41c8da-9799-4711-ba38-8ac0dfc02014 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:35.975619 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-6a41c8da-9799-4711-ba38-8ac0dfc02014 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:35.977131 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-6a41c8da-9799-4711-ba38-8ac0dfc02014 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:35.978325 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-6a41c8da-9799-4711-ba38-8ac0dfc02014 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1810 microversion: 2.20 time: 0.162888 Sep 21 12:25:35.988663 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 306/619] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:35 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:25:37.009649 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-4f38ef2b-e1a6-46fa-aa4e-67b42bf2d15b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:37.010269 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-4f38ef2b-e1a6-46fa-aa4e-67b42bf2d15b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:37.017098 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4f38ef2b-e1a6-46fa-aa4e-67b42bf2d15b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:37.017519 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4f38ef2b-e1a6-46fa-aa4e-67b42bf2d15b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:37.017959 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4f38ef2b-e1a6-46fa-aa4e-67b42bf2d15b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:37.018653 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4f38ef2b-e1a6-46fa-aa4e-67b42bf2d15b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:37.019109 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4f38ef2b-e1a6-46fa-aa4e-67b42bf2d15b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:37.019537 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4f38ef2b-e1a6-46fa-aa4e-67b42bf2d15b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:37.152854 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-4f38ef2b-e1a6-46fa-aa4e-67b42bf2d15b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:37.162040 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-4f38ef2b-e1a6-46fa-aa4e-67b42bf2d15b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:37.163476 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-4f38ef2b-e1a6-46fa-aa4e-67b42bf2d15b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:37.164919 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-4f38ef2b-e1a6-46fa-aa4e-67b42bf2d15b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1810 microversion: 2.20 time: 0.159480 Sep 21 12:25:37.165479 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 314/620] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:37 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:25:38.194360 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-72d11899-9e39-4c07-a468-e45750d937da tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:38.194360 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-72d11899-9e39-4c07-a468-e45750d937da tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:38.202458 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-72d11899-9e39-4c07-a468-e45750d937da tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:38.202458 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-72d11899-9e39-4c07-a468-e45750d937da tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:38.202458 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-72d11899-9e39-4c07-a468-e45750d937da tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:38.202458 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-72d11899-9e39-4c07-a468-e45750d937da tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:38.209964 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-72d11899-9e39-4c07-a468-e45750d937da tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:38.209964 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-72d11899-9e39-4c07-a468-e45750d937da tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:38.348309 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-72d11899-9e39-4c07-a468-e45750d937da tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:38.357851 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-72d11899-9e39-4c07-a468-e45750d937da tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:38.359312 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-72d11899-9e39-4c07-a468-e45750d937da tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:38.360548 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-72d11899-9e39-4c07-a468-e45750d937da tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1810 microversion: 2.20 time: 0.172007 Sep 21 12:25:38.361467 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 307/621] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:38 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:39.387078 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-a323cbb0-80b8-4db4-8591-3db7d8ea3ce4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:39.387787 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-a323cbb0-80b8-4db4-8591-3db7d8ea3ce4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:39.397685 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a323cbb0-80b8-4db4-8591-3db7d8ea3ce4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:39.398202 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a323cbb0-80b8-4db4-8591-3db7d8ea3ce4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:39.398654 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a323cbb0-80b8-4db4-8591-3db7d8ea3ce4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:39.399388 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a323cbb0-80b8-4db4-8591-3db7d8ea3ce4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:39.402910 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a323cbb0-80b8-4db4-8591-3db7d8ea3ce4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:39.402910 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a323cbb0-80b8-4db4-8591-3db7d8ea3ce4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:39.600889 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-a323cbb0-80b8-4db4-8591-3db7d8ea3ce4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:39.610457 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-a323cbb0-80b8-4db4-8591-3db7d8ea3ce4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:39.611956 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-a323cbb0-80b8-4db4-8591-3db7d8ea3ce4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:39.613145 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-a323cbb0-80b8-4db4-8591-3db7d8ea3ce4 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1810 microversion: 2.20 time: 0.230290 Sep 21 12:25:39.613707 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 315/622] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:39 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1810 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:40.639538 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-c94beeca-4c66-4b40-a03c-0951371e2474 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:40.640268 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-c94beeca-4c66-4b40-a03c-0951371e2474 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:40.646778 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c94beeca-4c66-4b40-a03c-0951371e2474 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:40.647258 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c94beeca-4c66-4b40-a03c-0951371e2474 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:40.647693 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c94beeca-4c66-4b40-a03c-0951371e2474 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:40.648404 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c94beeca-4c66-4b40-a03c-0951371e2474 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:40.648850 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c94beeca-4c66-4b40-a03c-0951371e2474 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:40.649271 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c94beeca-4c66-4b40-a03c-0951371e2474 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:40.836753 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-c94beeca-4c66-4b40-a03c-0951371e2474 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:40.845273 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-c94beeca-4c66-4b40-a03c-0951371e2474 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:40.846741 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-c94beeca-4c66-4b40-a03c-0951371e2474 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:40.847942 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-c94beeca-4c66-4b40-a03c-0951371e2474 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1810 microversion: 2.20 time: 0.213204 Sep 21 12:25:40.848512 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 308/623] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:40 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1810 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:41.874098 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-ea37296e-1d7b-4d4c-aa1d-d29e44bc9fbd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:41.874769 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-ea37296e-1d7b-4d4c-aa1d-d29e44bc9fbd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:41.881434 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ea37296e-1d7b-4d4c-aa1d-d29e44bc9fbd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:41.881927 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ea37296e-1d7b-4d4c-aa1d-d29e44bc9fbd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:41.882366 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ea37296e-1d7b-4d4c-aa1d-d29e44bc9fbd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:41.883073 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ea37296e-1d7b-4d4c-aa1d-d29e44bc9fbd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:41.883559 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ea37296e-1d7b-4d4c-aa1d-d29e44bc9fbd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:41.884036 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ea37296e-1d7b-4d4c-aa1d-d29e44bc9fbd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:41.899897 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:25:42.022512 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-ea37296e-1d7b-4d4c-aa1d-d29e44bc9fbd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:42.031451 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-ea37296e-1d7b-4d4c-aa1d-d29e44bc9fbd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:42.032937 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-ea37296e-1d7b-4d4c-aa1d-d29e44bc9fbd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:42.034108 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-ea37296e-1d7b-4d4c-aa1d-d29e44bc9fbd tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1810 microversion: 2.20 time: 0.164019 Sep 21 12:25:42.034692 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 316/624] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:41 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:43.059388 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-6cdf30b2-8d9d-4255-846f-08cbf0b57521 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:43.060029 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-6cdf30b2-8d9d-4255-846f-08cbf0b57521 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:43.067191 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6cdf30b2-8d9d-4255-846f-08cbf0b57521 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:43.067679 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6cdf30b2-8d9d-4255-846f-08cbf0b57521 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:43.068148 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6cdf30b2-8d9d-4255-846f-08cbf0b57521 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:43.068842 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6cdf30b2-8d9d-4255-846f-08cbf0b57521 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:43.069308 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6cdf30b2-8d9d-4255-846f-08cbf0b57521 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:43.069731 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6cdf30b2-8d9d-4255-846f-08cbf0b57521 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:43.197752 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-6cdf30b2-8d9d-4255-846f-08cbf0b57521 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:43.207253 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-6cdf30b2-8d9d-4255-846f-08cbf0b57521 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:43.208740 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-6cdf30b2-8d9d-4255-846f-08cbf0b57521 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:43.209905 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-6cdf30b2-8d9d-4255-846f-08cbf0b57521 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1810 microversion: 2.20 time: 0.154325 Sep 21 12:25:43.210559 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 309/625] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:43 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:44.235646 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-b01a5639-aa4a-4d42-a4dc-2738a3ca0007 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:44.236294 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-b01a5639-aa4a-4d42-a4dc-2738a3ca0007 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:44.242600 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b01a5639-aa4a-4d42-a4dc-2738a3ca0007 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:44.243078 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b01a5639-aa4a-4d42-a4dc-2738a3ca0007 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:44.243504 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b01a5639-aa4a-4d42-a4dc-2738a3ca0007 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:44.244234 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b01a5639-aa4a-4d42-a4dc-2738a3ca0007 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:44.244681 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b01a5639-aa4a-4d42-a4dc-2738a3ca0007 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:44.245098 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b01a5639-aa4a-4d42-a4dc-2738a3ca0007 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:44.375229 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-b01a5639-aa4a-4d42-a4dc-2738a3ca0007 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:44.384315 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-b01a5639-aa4a-4d42-a4dc-2738a3ca0007 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:44.385963 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-b01a5639-aa4a-4d42-a4dc-2738a3ca0007 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:44.387354 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-b01a5639-aa4a-4d42-a4dc-2738a3ca0007 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1810 microversion: 2.20 time: 0.155581 Sep 21 12:25:44.387926 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 317/626] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:44 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:45.413344 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-baa4e377-f09c-4b18-9db3-252196b28613 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:45.413929 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-baa4e377-f09c-4b18-9db3-252196b28613 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:45.420265 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-baa4e377-f09c-4b18-9db3-252196b28613 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:45.421249 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-baa4e377-f09c-4b18-9db3-252196b28613 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:45.421680 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-baa4e377-f09c-4b18-9db3-252196b28613 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:45.422358 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-baa4e377-f09c-4b18-9db3-252196b28613 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:45.422806 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-baa4e377-f09c-4b18-9db3-252196b28613 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:45.423228 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-baa4e377-f09c-4b18-9db3-252196b28613 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:45.555343 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-baa4e377-f09c-4b18-9db3-252196b28613 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:45.564019 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-baa4e377-f09c-4b18-9db3-252196b28613 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:45.565480 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-baa4e377-f09c-4b18-9db3-252196b28613 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:45.566645 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-baa4e377-f09c-4b18-9db3-252196b28613 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1810 microversion: 2.20 time: 0.157226 Sep 21 12:25:45.567202 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 310/627] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:45 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:46.592178 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-6274ea7e-4688-471f-b531-2bc0740c180a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:46.592755 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-6274ea7e-4688-471f-b531-2bc0740c180a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:46.594995 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:25:46.600736 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6274ea7e-4688-471f-b531-2bc0740c180a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:46.601231 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6274ea7e-4688-471f-b531-2bc0740c180a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:46.601676 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6274ea7e-4688-471f-b531-2bc0740c180a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:46.602413 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6274ea7e-4688-471f-b531-2bc0740c180a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:46.602878 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6274ea7e-4688-471f-b531-2bc0740c180a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:46.603306 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6274ea7e-4688-471f-b531-2bc0740c180a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:46.736937 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-6274ea7e-4688-471f-b531-2bc0740c180a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:46.745636 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-6274ea7e-4688-471f-b531-2bc0740c180a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:46.747092 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-6274ea7e-4688-471f-b531-2bc0740c180a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:46.749193 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-6274ea7e-4688-471f-b531-2bc0740c180a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1810 microversion: 2.20 time: 0.160371 Sep 21 12:25:46.749765 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 318/628] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:46 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:47.774813 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-da2ee3a8-f2ca-4ed5-8751-eaead9a69e19 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:47.775426 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-da2ee3a8-f2ca-4ed5-8751-eaead9a69e19 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:47.782144 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-da2ee3a8-f2ca-4ed5-8751-eaead9a69e19 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:47.782619 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-da2ee3a8-f2ca-4ed5-8751-eaead9a69e19 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:47.783062 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-da2ee3a8-f2ca-4ed5-8751-eaead9a69e19 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:47.783800 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-da2ee3a8-f2ca-4ed5-8751-eaead9a69e19 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:47.784255 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-da2ee3a8-f2ca-4ed5-8751-eaead9a69e19 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:47.784687 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-da2ee3a8-f2ca-4ed5-8751-eaead9a69e19 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:47.914435 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-da2ee3a8-f2ca-4ed5-8751-eaead9a69e19 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:47.923827 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-da2ee3a8-f2ca-4ed5-8751-eaead9a69e19 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:47.925336 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-da2ee3a8-f2ca-4ed5-8751-eaead9a69e19 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:47.926571 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-da2ee3a8-f2ca-4ed5-8751-eaead9a69e19 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1810 microversion: 2.20 time: 0.155800 Sep 21 12:25:47.927176 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 311/629] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:47 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:25:48.952972 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-f3d57700-dad5-408e-9e55-ef1e34b1a110 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:48.953608 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-f3d57700-dad5-408e-9e55-ef1e34b1a110 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:48.960317 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f3d57700-dad5-408e-9e55-ef1e34b1a110 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:48.960833 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f3d57700-dad5-408e-9e55-ef1e34b1a110 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:48.961299 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f3d57700-dad5-408e-9e55-ef1e34b1a110 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:48.962018 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f3d57700-dad5-408e-9e55-ef1e34b1a110 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:48.962475 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f3d57700-dad5-408e-9e55-ef1e34b1a110 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:48.962934 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f3d57700-dad5-408e-9e55-ef1e34b1a110 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:49.090970 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-f3d57700-dad5-408e-9e55-ef1e34b1a110 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:49.099632 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-f3d57700-dad5-408e-9e55-ef1e34b1a110 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:49.101137 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-f3d57700-dad5-408e-9e55-ef1e34b1a110 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:49.102311 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-f3d57700-dad5-408e-9e55-ef1e34b1a110 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1810 microversion: 2.20 time: 0.153543 Sep 21 12:25:49.102882 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 319/630] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:48 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:50.129744 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-9e0330db-bb1c-4ed4-bf3c-2a54e7b329a5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:50.130351 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-9e0330db-bb1c-4ed4-bf3c-2a54e7b329a5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:50.136368 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9e0330db-bb1c-4ed4-bf3c-2a54e7b329a5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:50.136849 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9e0330db-bb1c-4ed4-bf3c-2a54e7b329a5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:50.137282 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9e0330db-bb1c-4ed4-bf3c-2a54e7b329a5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:50.137961 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9e0330db-bb1c-4ed4-bf3c-2a54e7b329a5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:50.138413 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9e0330db-bb1c-4ed4-bf3c-2a54e7b329a5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:50.138838 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9e0330db-bb1c-4ed4-bf3c-2a54e7b329a5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:50.267608 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-9e0330db-bb1c-4ed4-bf3c-2a54e7b329a5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:50.276113 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-9e0330db-bb1c-4ed4-bf3c-2a54e7b329a5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:50.277568 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-9e0330db-bb1c-4ed4-bf3c-2a54e7b329a5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:50.278713 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-9e0330db-bb1c-4ed4-bf3c-2a54e7b329a5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1810 microversion: 2.20 time: 0.152943 Sep 21 12:25:50.279278 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 312/631] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:50 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:51.407029 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-690a1847-4c03-4f04-b856-7f66779465d2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:51.407644 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-690a1847-4c03-4f04-b856-7f66779465d2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:51.414060 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-690a1847-4c03-4f04-b856-7f66779465d2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:51.414557 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-690a1847-4c03-4f04-b856-7f66779465d2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:51.414997 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-690a1847-4c03-4f04-b856-7f66779465d2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:51.415714 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-690a1847-4c03-4f04-b856-7f66779465d2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:51.416195 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-690a1847-4c03-4f04-b856-7f66779465d2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:51.416625 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-690a1847-4c03-4f04-b856-7f66779465d2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:51.564619 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-690a1847-4c03-4f04-b856-7f66779465d2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:51.573102 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-690a1847-4c03-4f04-b856-7f66779465d2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:51.574539 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-690a1847-4c03-4f04-b856-7f66779465d2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:51.575735 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-690a1847-4c03-4f04-b856-7f66779465d2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1810 microversion: 2.20 time: 0.274270 Sep 21 12:25:51.576322 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 320/632] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:51 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1810 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:52.601594 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-4fe301f5-e102-4df0-8164-8d76f20edf69 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:52.602207 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-4fe301f5-e102-4df0-8164-8d76f20edf69 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:52.608865 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4fe301f5-e102-4df0-8164-8d76f20edf69 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:52.609353 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4fe301f5-e102-4df0-8164-8d76f20edf69 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:52.609798 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4fe301f5-e102-4df0-8164-8d76f20edf69 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:52.610490 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4fe301f5-e102-4df0-8164-8d76f20edf69 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:52.610951 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4fe301f5-e102-4df0-8164-8d76f20edf69 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:52.611383 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4fe301f5-e102-4df0-8164-8d76f20edf69 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:52.744535 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-4fe301f5-e102-4df0-8164-8d76f20edf69 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:52.753843 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-4fe301f5-e102-4df0-8164-8d76f20edf69 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:52.755341 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-4fe301f5-e102-4df0-8164-8d76f20edf69 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:52.756576 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-4fe301f5-e102-4df0-8164-8d76f20edf69 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1810 microversion: 2.20 time: 0.158917 Sep 21 12:25:52.757147 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 313/633] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:52 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:53.783057 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-e01a2b48-a48d-465b-82ee-4d2f03224231 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:53.783672 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-e01a2b48-a48d-465b-82ee-4d2f03224231 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:53.790326 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e01a2b48-a48d-465b-82ee-4d2f03224231 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:53.790816 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e01a2b48-a48d-465b-82ee-4d2f03224231 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:53.791280 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e01a2b48-a48d-465b-82ee-4d2f03224231 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:53.792009 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e01a2b48-a48d-465b-82ee-4d2f03224231 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:53.792473 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e01a2b48-a48d-465b-82ee-4d2f03224231 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:53.792905 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e01a2b48-a48d-465b-82ee-4d2f03224231 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:53.919119 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-e01a2b48-a48d-465b-82ee-4d2f03224231 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:53.928474 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-e01a2b48-a48d-465b-82ee-4d2f03224231 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:53.929921 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-e01a2b48-a48d-465b-82ee-4d2f03224231 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:53.931087 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-e01a2b48-a48d-465b-82ee-4d2f03224231 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1810 microversion: 2.20 time: 0.152531 Sep 21 12:25:53.931653 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 321/634] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:53 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:54.957602 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-4e41991f-06ca-49ba-a6d0-46577f1289ef tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:54.958241 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-4e41991f-06ca-49ba-a6d0-46577f1289ef tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:54.960621 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=32 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:25:54.965799 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4e41991f-06ca-49ba-a6d0-46577f1289ef tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:54.966287 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4e41991f-06ca-49ba-a6d0-46577f1289ef tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:54.966725 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4e41991f-06ca-49ba-a6d0-46577f1289ef tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:54.967422 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4e41991f-06ca-49ba-a6d0-46577f1289ef tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:54.967902 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4e41991f-06ca-49ba-a6d0-46577f1289ef tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:54.968330 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4e41991f-06ca-49ba-a6d0-46577f1289ef tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:55.104961 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-4e41991f-06ca-49ba-a6d0-46577f1289ef tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:55.113816 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-4e41991f-06ca-49ba-a6d0-46577f1289ef tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:55.115271 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-4e41991f-06ca-49ba-a6d0-46577f1289ef tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:55.116479 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-4e41991f-06ca-49ba-a6d0-46577f1289ef tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1810 microversion: 2.20 time: 0.162873 Sep 21 12:25:55.117057 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 314/635] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:54 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:56.143124 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-a6063ac3-89a0-47ec-b2b8-6fd985831bce tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:56.144164 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-a6063ac3-89a0-47ec-b2b8-6fd985831bce tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:56.154100 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a6063ac3-89a0-47ec-b2b8-6fd985831bce tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:56.154944 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a6063ac3-89a0-47ec-b2b8-6fd985831bce tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:56.155672 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a6063ac3-89a0-47ec-b2b8-6fd985831bce tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:56.156861 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a6063ac3-89a0-47ec-b2b8-6fd985831bce tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:56.157652 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a6063ac3-89a0-47ec-b2b8-6fd985831bce tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:56.158319 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a6063ac3-89a0-47ec-b2b8-6fd985831bce tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:56.547804 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-a6063ac3-89a0-47ec-b2b8-6fd985831bce tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:56.556441 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-a6063ac3-89a0-47ec-b2b8-6fd985831bce tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:56.557876 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-a6063ac3-89a0-47ec-b2b8-6fd985831bce tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:56.559036 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-a6063ac3-89a0-47ec-b2b8-6fd985831bce tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1810 microversion: 2.20 time: 0.420816 Sep 21 12:25:56.559602 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 322/636] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:56 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1810 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:57.104230 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-293faf42-b179-4f2f-89fd-d7eaf02a0e0b req-408d76d8-523c-4886-a7af-600eb7561267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e9ebd08-4c95-43f6-a1a4-3268532d961e", "name": "network-vif-plugged", "status": "completed", "tag": "1f39c2aa-a245-4b77-8233-20f0c6c6cb30"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:25:57.115482 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-293faf42-b179-4f2f-89fd-d7eaf02a0e0b req-408d76d8-523c-4886-a7af-600eb7561267 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:57.115928 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-293faf42-b179-4f2f-89fd-d7eaf02a0e0b req-408d76d8-523c-4886-a7af-600eb7561267 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:57.116372 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-293faf42-b179-4f2f-89fd-d7eaf02a0e0b req-408d76d8-523c-4886-a7af-600eb7561267 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:57.119234 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:25:57.129357 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-293faf42-b179-4f2f-89fd-d7eaf02a0e0b req-408d76d8-523c-4886-a7af-600eb7561267 service nova] Creating event network-vif-plugged:1f39c2aa-a245-4b77-8233-20f0c6c6cb30 for instance 5e9ebd08-4c95-43f6-a1a4-3268532d961e on hv-cinder-85867 Sep 21 12:25:57.134934 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-293faf42-b179-4f2f-89fd-d7eaf02a0e0b req-408d76d8-523c-4886-a7af-600eb7561267 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034293 Sep 21 12:25:57.135642 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 315/637] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:25:57.585197 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-1fe7cc32-c8cb-4ed0-8ac3-1857f39d1f99 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:57.586270 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-1fe7cc32-c8cb-4ed0-8ac3-1857f39d1f99 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:57.592603 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1fe7cc32-c8cb-4ed0-8ac3-1857f39d1f99 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:57.593097 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1fe7cc32-c8cb-4ed0-8ac3-1857f39d1f99 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:57.593609 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1fe7cc32-c8cb-4ed0-8ac3-1857f39d1f99 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:57.594287 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1fe7cc32-c8cb-4ed0-8ac3-1857f39d1f99 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:57.594946 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1fe7cc32-c8cb-4ed0-8ac3-1857f39d1f99 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:57.595242 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1fe7cc32-c8cb-4ed0-8ac3-1857f39d1f99 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:57.734893 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-1fe7cc32-c8cb-4ed0-8ac3-1857f39d1f99 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:57.745938 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-1fe7cc32-c8cb-4ed0-8ac3-1857f39d1f99 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:57.747402 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-1fe7cc32-c8cb-4ed0-8ac3-1857f39d1f99 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:57.749985 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-1fe7cc32-c8cb-4ed0-8ac3-1857f39d1f99 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1810 microversion: 2.20 time: 0.168572 Sep 21 12:25:57.750781 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 323/638] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:57 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:58.777750 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-9741f75f-e6ba-4c0c-a635-15eb6ff2261a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:58.778507 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-9741f75f-e6ba-4c0c-a635-15eb6ff2261a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:58.786967 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9741f75f-e6ba-4c0c-a635-15eb6ff2261a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:58.787455 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9741f75f-e6ba-4c0c-a635-15eb6ff2261a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:58.787935 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9741f75f-e6ba-4c0c-a635-15eb6ff2261a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:58.788640 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9741f75f-e6ba-4c0c-a635-15eb6ff2261a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:58.789095 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9741f75f-e6ba-4c0c-a635-15eb6ff2261a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:58.789525 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9741f75f-e6ba-4c0c-a635-15eb6ff2261a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:58.917951 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-9741f75f-e6ba-4c0c-a635-15eb6ff2261a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:58.926442 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-9741f75f-e6ba-4c0c-a635-15eb6ff2261a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:58.928037 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-9741f75f-e6ba-4c0c-a635-15eb6ff2261a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:25:58.929192 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-9741f75f-e6ba-4c0c-a635-15eb6ff2261a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1810 microversion: 2.20 time: 0.156244 Sep 21 12:25:58.929746 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 316/639] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:58 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:25:59.955389 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-601cd87b-9182-474c-8764-6ccf4b425ea1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:25:59.956367 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-601cd87b-9182-474c-8764-6ccf4b425ea1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:25:59.963245 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-601cd87b-9182-474c-8764-6ccf4b425ea1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:59.963726 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-601cd87b-9182-474c-8764-6ccf4b425ea1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:59.964212 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-601cd87b-9182-474c-8764-6ccf4b425ea1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:25:59.964917 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-601cd87b-9182-474c-8764-6ccf4b425ea1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:25:59.965374 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-601cd87b-9182-474c-8764-6ccf4b425ea1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:25:59.965803 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-601cd87b-9182-474c-8764-6ccf4b425ea1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:00.093459 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-601cd87b-9182-474c-8764-6ccf4b425ea1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:26:00.102673 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-601cd87b-9182-474c-8764-6ccf4b425ea1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:26:00.103904 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-601cd87b-9182-474c-8764-6ccf4b425ea1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:26:00.105039 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-601cd87b-9182-474c-8764-6ccf4b425ea1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1810 microversion: 2.20 time: 0.154616 Sep 21 12:26:00.107160 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 324/640] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:25:59 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:26:01.130725 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-0457ddb5-9c94-4d23-ba3b-4dea206f7684 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:26:01.131333 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-0457ddb5-9c94-4d23-ba3b-4dea206f7684 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:26:01.137695 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0457ddb5-9c94-4d23-ba3b-4dea206f7684 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:01.138167 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0457ddb5-9c94-4d23-ba3b-4dea206f7684 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:01.139103 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0457ddb5-9c94-4d23-ba3b-4dea206f7684 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:01.139804 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0457ddb5-9c94-4d23-ba3b-4dea206f7684 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:01.140258 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0457ddb5-9c94-4d23-ba3b-4dea206f7684 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:01.140684 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0457ddb5-9c94-4d23-ba3b-4dea206f7684 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:01.265949 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-0457ddb5-9c94-4d23-ba3b-4dea206f7684 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:26:01.274492 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-0457ddb5-9c94-4d23-ba3b-4dea206f7684 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:26:01.276041 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-0457ddb5-9c94-4d23-ba3b-4dea206f7684 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:26:01.277178 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-0457ddb5-9c94-4d23-ba3b-4dea206f7684 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1797 microversion: 2.20 time: 0.150374 Sep 21 12:26:01.277744 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 317/641] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:26:01 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1797 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:26:43.365977 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_api:SELECT=13 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:26:43.366719 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=51 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:26:43.464118 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-2671a152-865f-4b14-a0dd-5013fdb3f32b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:26:43.464620 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-2671a152-865f-4b14-a0dd-5013fdb3f32b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:26:43.471007 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2671a152-865f-4b14-a0dd-5013fdb3f32b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:43.471492 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2671a152-865f-4b14-a0dd-5013fdb3f32b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:43.471968 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2671a152-865f-4b14-a0dd-5013fdb3f32b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:43.472663 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2671a152-865f-4b14-a0dd-5013fdb3f32b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:43.473122 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2671a152-865f-4b14-a0dd-5013fdb3f32b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:43.473553 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2671a152-865f-4b14-a0dd-5013fdb3f32b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:43.599163 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.objects.instance [None req-2671a152-865f-4b14-a0dd-5013fdb3f32b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lazy-loading 'services' on Instance uuid ee010d1f-46d4-487e-a93e-66c5e2ac895e {{(pid=120462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 12:26:43.710005 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-2671a152-865f-4b14-a0dd-5013fdb3f32b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "DELETE /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e/os-volume_attachments/f9717b74-cf62-4ca4-8419-e4805971dcab" status: 202 len: 0 microversion: 2.1 time: 0.348836 Sep 21 12:26:43.710597 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 325/642] 10.222.0.71 () {58 vars in 1416 bytes} [Wed Sep 21 12:26:43 2022] DELETE /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e/os-volume_attachments/f9717b74-cf62-4ca4-8419-e4805971dcab => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 12:26:44.834129 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-e9572c07-5111-4294-880f-336604792e4c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:26:44.836537 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 21 12:26:44.836687 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Wed Sep 21 12:26:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e/action (ip 10.222.0.71) !!! Sep 21 12:26:44.838945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=7 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:26:44.839779 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=13 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:26:44.853061 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e9572c07-5111-4294-880f-336604792e4c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:44.853671 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e9572c07-5111-4294-880f-336604792e4c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:44.854253 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e9572c07-5111-4294-880f-336604792e4c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:44.879293 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-e9572c07-5111-4294-880f-336604792e4c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Going to try to stop instance {{(pid=120463) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 21 12:26:44.926242 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-e9572c07-5111-4294-880f-336604792e4c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "POST /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e/action" status: 202 len: 0 microversion: 2.1 time: 0.097437 Sep 21 12:26:44.927102 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 318/643] 10.222.0.71 () {60 vars in 1278 bytes} [Wed Sep 21 12:26:44 2022] POST /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 12:26:44.936242 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-41691fc8-988b-4e01-a281-5092c68f86bd tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:26:44.937279 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-41691fc8-988b-4e01-a281-5092c68f86bd tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:26:44.943974 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-41691fc8-988b-4e01-a281-5092c68f86bd tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:44.944461 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-41691fc8-988b-4e01-a281-5092c68f86bd tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:44.944903 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-41691fc8-988b-4e01-a281-5092c68f86bd tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:44.945604 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-41691fc8-988b-4e01-a281-5092c68f86bd tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:44.946057 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-41691fc8-988b-4e01-a281-5092c68f86bd tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:44.946489 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-41691fc8-988b-4e01-a281-5092c68f86bd tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:45.078768 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-41691fc8-988b-4e01-a281-5092c68f86bd tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:26:45.087061 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-41691fc8-988b-4e01-a281-5092c68f86bd tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1676 microversion: 2.1 time: 0.155782 Sep 21 12:26:45.087627 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 326/644] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:26:44 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:26:46.112513 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-73a46b74-c202-4957-810a-27cc7eec4921 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:26:46.113222 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-73a46b74-c202-4957-810a-27cc7eec4921 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:26:46.119748 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-73a46b74-c202-4957-810a-27cc7eec4921 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:46.121335 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-73a46b74-c202-4957-810a-27cc7eec4921 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:46.121787 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-73a46b74-c202-4957-810a-27cc7eec4921 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:46.122494 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-73a46b74-c202-4957-810a-27cc7eec4921 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:46.122963 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-73a46b74-c202-4957-810a-27cc7eec4921 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:46.123383 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-73a46b74-c202-4957-810a-27cc7eec4921 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:46.262767 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-73a46b74-c202-4957-810a-27cc7eec4921 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:26:46.270490 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-73a46b74-c202-4957-810a-27cc7eec4921 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1676 microversion: 2.1 time: 0.163346 Sep 21 12:26:46.271056 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 319/645] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:26:46 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:26:47.293570 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-42b57c59-b1d3-460a-aee7-7a54f11dbf5a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:26:47.294169 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-42b57c59-b1d3-460a-aee7-7a54f11dbf5a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:26:47.301067 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-42b57c59-b1d3-460a-aee7-7a54f11dbf5a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:47.301553 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-42b57c59-b1d3-460a-aee7-7a54f11dbf5a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:47.301996 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-42b57c59-b1d3-460a-aee7-7a54f11dbf5a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:47.302698 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-42b57c59-b1d3-460a-aee7-7a54f11dbf5a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:47.303152 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-42b57c59-b1d3-460a-aee7-7a54f11dbf5a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:47.303587 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-42b57c59-b1d3-460a-aee7-7a54f11dbf5a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:47.436907 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-42b57c59-b1d3-460a-aee7-7a54f11dbf5a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:26:47.445469 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-42b57c59-b1d3-460a-aee7-7a54f11dbf5a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1676 microversion: 2.1 time: 0.155649 Sep 21 12:26:47.446035 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 327/646] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:26:47 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:26:48.468549 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-92540296-3f18-4963-afa9-2baf4f1ca771 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:26:48.469157 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-92540296-3f18-4963-afa9-2baf4f1ca771 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:26:48.475263 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-92540296-3f18-4963-afa9-2baf4f1ca771 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:48.475745 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-92540296-3f18-4963-afa9-2baf4f1ca771 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:48.476205 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-92540296-3f18-4963-afa9-2baf4f1ca771 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:48.476884 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-92540296-3f18-4963-afa9-2baf4f1ca771 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:48.477332 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-92540296-3f18-4963-afa9-2baf4f1ca771 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:48.477753 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-92540296-3f18-4963-afa9-2baf4f1ca771 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:48.618068 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-92540296-3f18-4963-afa9-2baf4f1ca771 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:26:48.627270 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-92540296-3f18-4963-afa9-2baf4f1ca771 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1676 microversion: 2.1 time: 0.162466 Sep 21 12:26:48.640066 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 320/647] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:26:48 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:26:49.621776 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-45808dca-4167-4fed-836b-abe3c3980ab7 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:26:49.625321 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-45808dca-4167-4fed-836b-abe3c3980ab7 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:26:49.631136 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-45808dca-4167-4fed-836b-abe3c3980ab7 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:49.631623 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-45808dca-4167-4fed-836b-abe3c3980ab7 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:49.632099 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-45808dca-4167-4fed-836b-abe3c3980ab7 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:49.632804 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-45808dca-4167-4fed-836b-abe3c3980ab7 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:49.633293 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-45808dca-4167-4fed-836b-abe3c3980ab7 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:49.633720 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-45808dca-4167-4fed-836b-abe3c3980ab7 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:49.651110 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-4bc358fd-ac16-4aee-aade-18d59d1679f8 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:26:49.651735 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-4bc358fd-ac16-4aee-aade-18d59d1679f8 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:26:49.659350 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4bc358fd-ac16-4aee-aade-18d59d1679f8 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:49.659871 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4bc358fd-ac16-4aee-aade-18d59d1679f8 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:49.660318 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4bc358fd-ac16-4aee-aade-18d59d1679f8 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:49.661025 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4bc358fd-ac16-4aee-aade-18d59d1679f8 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:49.661513 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4bc358fd-ac16-4aee-aade-18d59d1679f8 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:49.661943 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4bc358fd-ac16-4aee-aade-18d59d1679f8 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:49.711772 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-45808dca-4167-4fed-836b-abe3c3980ab7 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "POST /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9/action" status: 202 len: 0 microversion: 2.1 time: 0.094198 Sep 21 12:26:49.713878 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 328/648] 10.222.0.71 () {60 vars in 1278 bytes} [Wed Sep 21 12:26:49 2022] POST /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 21 12:26:49.721749 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-50e74639-cc0f-43c4-9c92-641085b5fe8d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:26:49.722467 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-50e74639-cc0f-43c4-9c92-641085b5fe8d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:26:49.728891 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-50e74639-cc0f-43c4-9c92-641085b5fe8d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:49.729427 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-50e74639-cc0f-43c4-9c92-641085b5fe8d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:49.729860 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-50e74639-cc0f-43c4-9c92-641085b5fe8d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:49.730695 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-50e74639-cc0f-43c4-9c92-641085b5fe8d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:49.731192 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-50e74639-cc0f-43c4-9c92-641085b5fe8d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:49.732050 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-50e74639-cc0f-43c4-9c92-641085b5fe8d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:49.799333 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-4bc358fd-ac16-4aee-aade-18d59d1679f8 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:26:49.807441 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-4bc358fd-ac16-4aee-aade-18d59d1679f8 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1676 microversion: 2.1 time: 0.160081 Sep 21 12:26:49.808337 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 321/649] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:26:49 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:26:49.964051 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-50e74639-cc0f-43c4-9c92-641085b5fe8d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:26:49.972440 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-50e74639-cc0f-43c4-9c92-641085b5fe8d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1750 microversion: 2.1 time: 0.255290 Sep 21 12:26:49.973043 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 329/650] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:26:49 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1750 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:26:50.831155 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-151eb3e3-55ab-450a-ad89-c48732d64cb4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:26:50.831780 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-151eb3e3-55ab-450a-ad89-c48732d64cb4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:26:50.838150 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-151eb3e3-55ab-450a-ad89-c48732d64cb4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:50.838630 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-151eb3e3-55ab-450a-ad89-c48732d64cb4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:50.839061 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-151eb3e3-55ab-450a-ad89-c48732d64cb4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:50.839797 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-151eb3e3-55ab-450a-ad89-c48732d64cb4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:50.840254 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-151eb3e3-55ab-450a-ad89-c48732d64cb4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:50.840677 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-151eb3e3-55ab-450a-ad89-c48732d64cb4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:50.966181 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-151eb3e3-55ab-450a-ad89-c48732d64cb4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:26:50.974607 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-151eb3e3-55ab-450a-ad89-c48732d64cb4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1676 microversion: 2.1 time: 0.147382 Sep 21 12:26:50.975198 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 322/651] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:26:50 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:26:50.996596 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-02e07dcc-f557-45b5-8455-8fbdbc93914d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:26:50.997203 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-02e07dcc-f557-45b5-8455-8fbdbc93914d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:26:51.003841 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-02e07dcc-f557-45b5-8455-8fbdbc93914d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:51.004322 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-02e07dcc-f557-45b5-8455-8fbdbc93914d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:51.004753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-02e07dcc-f557-45b5-8455-8fbdbc93914d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:51.005433 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-02e07dcc-f557-45b5-8455-8fbdbc93914d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:51.005880 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-02e07dcc-f557-45b5-8455-8fbdbc93914d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:51.006299 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-02e07dcc-f557-45b5-8455-8fbdbc93914d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:51.148426 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-02e07dcc-f557-45b5-8455-8fbdbc93914d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:26:51.156564 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-02e07dcc-f557-45b5-8455-8fbdbc93914d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1755 microversion: 2.1 time: 0.163756 Sep 21 12:26:51.157764 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 330/652] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:26:50 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:26:52.000591 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-f5cfc226-5ad4-4e7e-93b5-1c180e620749 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:26:52.001927 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-f5cfc226-5ad4-4e7e-93b5-1c180e620749 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:26:52.008439 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f5cfc226-5ad4-4e7e-93b5-1c180e620749 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:52.008934 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f5cfc226-5ad4-4e7e-93b5-1c180e620749 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:52.009379 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f5cfc226-5ad4-4e7e-93b5-1c180e620749 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:52.010086 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f5cfc226-5ad4-4e7e-93b5-1c180e620749 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:52.010546 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f5cfc226-5ad4-4e7e-93b5-1c180e620749 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:52.010981 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f5cfc226-5ad4-4e7e-93b5-1c180e620749 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:52.139866 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-f5cfc226-5ad4-4e7e-93b5-1c180e620749 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:26:52.147468 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-f5cfc226-5ad4-4e7e-93b5-1c180e620749 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1676 microversion: 2.1 time: 0.150919 Sep 21 12:26:52.148076 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 323/653] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:26:51 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:26:52.180759 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-2336ab79-39db-4281-81e1-60891ea8328e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:26:52.181374 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-2336ab79-39db-4281-81e1-60891ea8328e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:26:52.187824 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2336ab79-39db-4281-81e1-60891ea8328e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:52.188349 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2336ab79-39db-4281-81e1-60891ea8328e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:52.188785 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2336ab79-39db-4281-81e1-60891ea8328e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:52.189476 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2336ab79-39db-4281-81e1-60891ea8328e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:52.189937 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2336ab79-39db-4281-81e1-60891ea8328e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:52.190368 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2336ab79-39db-4281-81e1-60891ea8328e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:52.333961 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-2336ab79-39db-4281-81e1-60891ea8328e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:26:52.343708 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-2336ab79-39db-4281-81e1-60891ea8328e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1755 microversion: 2.1 time: 0.166662 Sep 21 12:26:52.344340 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 331/654] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:26:52 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:26:53.171591 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-224dc283-cc8f-48fd-8728-c6364b8c7ce5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:26:53.172307 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-224dc283-cc8f-48fd-8728-c6364b8c7ce5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:26:53.178701 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-224dc283-cc8f-48fd-8728-c6364b8c7ce5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:53.179192 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-224dc283-cc8f-48fd-8728-c6364b8c7ce5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:53.179638 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-224dc283-cc8f-48fd-8728-c6364b8c7ce5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:53.180373 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-224dc283-cc8f-48fd-8728-c6364b8c7ce5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:53.180835 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-224dc283-cc8f-48fd-8728-c6364b8c7ce5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:53.181269 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-224dc283-cc8f-48fd-8728-c6364b8c7ce5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:53.309278 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-224dc283-cc8f-48fd-8728-c6364b8c7ce5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:26:53.317807 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-224dc283-cc8f-48fd-8728-c6364b8c7ce5 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1676 microversion: 2.1 time: 0.150209 Sep 21 12:26:53.318380 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 324/655] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:26:53 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:26:53.369833 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-47ddf776-1020-4448-b558-204a92de0a22 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:26:53.370458 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-47ddf776-1020-4448-b558-204a92de0a22 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:26:53.377620 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-47ddf776-1020-4448-b558-204a92de0a22 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:53.378085 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-47ddf776-1020-4448-b558-204a92de0a22 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:53.378524 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-47ddf776-1020-4448-b558-204a92de0a22 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:53.379220 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-47ddf776-1020-4448-b558-204a92de0a22 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:53.379679 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-47ddf776-1020-4448-b558-204a92de0a22 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:53.380136 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-47ddf776-1020-4448-b558-204a92de0a22 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:53.522634 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-47ddf776-1020-4448-b558-204a92de0a22 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:26:53.530789 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-47ddf776-1020-4448-b558-204a92de0a22 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1755 microversion: 2.1 time: 0.164913 Sep 21 12:26:53.531360 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 332/656] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:26:53 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:26:54.341349 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-1dcf5175-f52d-4933-96e2-b6886a2862bf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:26:54.341966 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-1dcf5175-f52d-4933-96e2-b6886a2862bf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:26:54.348426 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1dcf5175-f52d-4933-96e2-b6886a2862bf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:54.348924 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1dcf5175-f52d-4933-96e2-b6886a2862bf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:54.349367 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1dcf5175-f52d-4933-96e2-b6886a2862bf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:54.350068 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1dcf5175-f52d-4933-96e2-b6886a2862bf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:54.350784 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1dcf5175-f52d-4933-96e2-b6886a2862bf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:54.351241 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1dcf5175-f52d-4933-96e2-b6886a2862bf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:54.477068 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-1dcf5175-f52d-4933-96e2-b6886a2862bf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:26:54.486147 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-1dcf5175-f52d-4933-96e2-b6886a2862bf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1676 microversion: 2.1 time: 0.148746 Sep 21 12:26:54.486720 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 325/657] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:26:54 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:26:54.554643 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-83b8cb4b-e922-4207-8f46-5bccd8388fe2 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:26:54.555257 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-83b8cb4b-e922-4207-8f46-5bccd8388fe2 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:26:54.561645 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-83b8cb4b-e922-4207-8f46-5bccd8388fe2 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:54.562197 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-83b8cb4b-e922-4207-8f46-5bccd8388fe2 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:54.562640 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-83b8cb4b-e922-4207-8f46-5bccd8388fe2 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:54.563342 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-83b8cb4b-e922-4207-8f46-5bccd8388fe2 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:54.563823 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-83b8cb4b-e922-4207-8f46-5bccd8388fe2 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:54.564251 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-83b8cb4b-e922-4207-8f46-5bccd8388fe2 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:54.706335 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-83b8cb4b-e922-4207-8f46-5bccd8388fe2 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:26:54.714442 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-83b8cb4b-e922-4207-8f46-5bccd8388fe2 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1755 microversion: 2.1 time: 0.163688 Sep 21 12:26:54.715009 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 333/658] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:26:54 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:26:55.509649 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-e297f48f-3175-44b0-b7e0-d343a5dbd057 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:26:55.510267 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-e297f48f-3175-44b0-b7e0-d343a5dbd057 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:26:55.517704 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e297f48f-3175-44b0-b7e0-d343a5dbd057 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:55.518190 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e297f48f-3175-44b0-b7e0-d343a5dbd057 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:55.518641 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e297f48f-3175-44b0-b7e0-d343a5dbd057 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:55.519336 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e297f48f-3175-44b0-b7e0-d343a5dbd057 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:55.519825 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e297f48f-3175-44b0-b7e0-d343a5dbd057 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:55.520260 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e297f48f-3175-44b0-b7e0-d343a5dbd057 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:55.655231 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-e297f48f-3175-44b0-b7e0-d343a5dbd057 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:26:55.663914 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-e297f48f-3175-44b0-b7e0-d343a5dbd057 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1653 microversion: 2.1 time: 0.158230 Sep 21 12:26:55.664916 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 326/659] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:26:55 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1653 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:26:55.687124 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-34bedbbc-7586-4cef-9dd0-a975aeefee2c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:26:55.693591 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-34bedbbc-7586-4cef-9dd0-a975aeefee2c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:55.694079 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-34bedbbc-7586-4cef-9dd0-a975aeefee2c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:55.694579 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-34bedbbc-7586-4cef-9dd0-a975aeefee2c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:55.737241 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-125b1b1c-bbcc-4345-91c4-f023a79f555d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:26:55.737866 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-125b1b1c-bbcc-4345-91c4-f023a79f555d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:26:55.744078 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-125b1b1c-bbcc-4345-91c4-f023a79f555d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:55.744588 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-125b1b1c-bbcc-4345-91c4-f023a79f555d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:55.745036 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-125b1b1c-bbcc-4345-91c4-f023a79f555d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:55.745747 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-125b1b1c-bbcc-4345-91c4-f023a79f555d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:55.746348 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-125b1b1c-bbcc-4345-91c4-f023a79f555d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:55.746790 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-125b1b1c-bbcc-4345-91c4-f023a79f555d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:55.754781 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-34bedbbc-7586-4cef-9dd0-a975aeefee2c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Going to try to start instance {{(pid=120462) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 21 12:26:55.798491 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-34bedbbc-7586-4cef-9dd0-a975aeefee2c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "POST /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e/action" status: 202 len: 0 microversion: 2.1 time: 0.115107 Sep 21 12:26:55.799133 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 334/660] 10.222.0.71 () {60 vars in 1278 bytes} [Wed Sep 21 12:26:55 2022] POST /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 12:26:55.808459 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-f602d641-26b9-4afd-85cf-eae09f6cdd8e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:26:55.809245 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-f602d641-26b9-4afd-85cf-eae09f6cdd8e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:26:55.816007 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f602d641-26b9-4afd-85cf-eae09f6cdd8e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:55.816558 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f602d641-26b9-4afd-85cf-eae09f6cdd8e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:55.817117 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f602d641-26b9-4afd-85cf-eae09f6cdd8e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:55.817976 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f602d641-26b9-4afd-85cf-eae09f6cdd8e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:55.818438 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f602d641-26b9-4afd-85cf-eae09f6cdd8e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:55.818899 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f602d641-26b9-4afd-85cf-eae09f6cdd8e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:55.895940 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-125b1b1c-bbcc-4345-91c4-f023a79f555d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:26:55.911542 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-125b1b1c-bbcc-4345-91c4-f023a79f555d tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1755 microversion: 2.1 time: 0.178024 Sep 21 12:26:55.912324 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 327/661] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:26:55 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:26:55.958202 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-f602d641-26b9-4afd-85cf-eae09f6cdd8e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:26:55.966099 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-f602d641-26b9-4afd-85cf-eae09f6cdd8e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1662 microversion: 2.1 time: 0.162525 Sep 21 12:26:55.966679 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 335/662] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:26:55 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1662 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:26:56.934422 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-6b34e362-06c4-4524-a929-55fb190f7209 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:26:56.935032 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-6b34e362-06c4-4524-a929-55fb190f7209 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:26:56.941379 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6b34e362-06c4-4524-a929-55fb190f7209 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:56.941855 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6b34e362-06c4-4524-a929-55fb190f7209 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:56.942289 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6b34e362-06c4-4524-a929-55fb190f7209 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:56.942973 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6b34e362-06c4-4524-a929-55fb190f7209 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:56.943420 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6b34e362-06c4-4524-a929-55fb190f7209 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:56.943866 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6b34e362-06c4-4524-a929-55fb190f7209 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:56.992529 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-42e6fe2a-1764-43d8-8211-98c1917ae30e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:26:56.993215 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-42e6fe2a-1764-43d8-8211-98c1917ae30e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:26:57.000367 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-42e6fe2a-1764-43d8-8211-98c1917ae30e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:57.001051 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-42e6fe2a-1764-43d8-8211-98c1917ae30e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:57.001486 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-42e6fe2a-1764-43d8-8211-98c1917ae30e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:57.002209 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-42e6fe2a-1764-43d8-8211-98c1917ae30e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:57.002637 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-42e6fe2a-1764-43d8-8211-98c1917ae30e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:57.003256 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-42e6fe2a-1764-43d8-8211-98c1917ae30e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:57.097539 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-6b34e362-06c4-4524-a929-55fb190f7209 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:26:57.106552 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-6b34e362-06c4-4524-a929-55fb190f7209 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1755 microversion: 2.1 time: 0.175917 Sep 21 12:26:57.107232 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 328/663] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:26:56 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:26:57.146493 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-42e6fe2a-1764-43d8-8211-98c1917ae30e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:26:57.154100 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-42e6fe2a-1764-43d8-8211-98c1917ae30e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1662 microversion: 2.1 time: 0.168649 Sep 21 12:26:57.154732 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 336/664] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:26:56 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1662 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:26:58.130066 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-e1fba02c-1d30-4ccd-913f-4f7329c8e2e9 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:26:58.130691 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-e1fba02c-1d30-4ccd-913f-4f7329c8e2e9 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:26:58.137085 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e1fba02c-1d30-4ccd-913f-4f7329c8e2e9 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:58.137566 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e1fba02c-1d30-4ccd-913f-4f7329c8e2e9 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:58.138007 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e1fba02c-1d30-4ccd-913f-4f7329c8e2e9 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:58.138704 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e1fba02c-1d30-4ccd-913f-4f7329c8e2e9 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:58.139165 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e1fba02c-1d30-4ccd-913f-4f7329c8e2e9 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:58.139618 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e1fba02c-1d30-4ccd-913f-4f7329c8e2e9 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:58.178170 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-6fdc97cc-1a49-48c5-add0-fac14256aaeb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:26:58.178786 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-6fdc97cc-1a49-48c5-add0-fac14256aaeb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:26:58.185180 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6fdc97cc-1a49-48c5-add0-fac14256aaeb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:58.185666 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6fdc97cc-1a49-48c5-add0-fac14256aaeb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:58.186101 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6fdc97cc-1a49-48c5-add0-fac14256aaeb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:58.186794 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6fdc97cc-1a49-48c5-add0-fac14256aaeb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:58.187250 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6fdc97cc-1a49-48c5-add0-fac14256aaeb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:58.187673 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6fdc97cc-1a49-48c5-add0-fac14256aaeb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:58.280166 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-e1fba02c-1d30-4ccd-913f-4f7329c8e2e9 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:26:58.288996 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-e1fba02c-1d30-4ccd-913f-4f7329c8e2e9 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1755 microversion: 2.1 time: 0.162840 Sep 21 12:26:58.289574 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 329/665] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:26:58 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:26:58.321931 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-6fdc97cc-1a49-48c5-add0-fac14256aaeb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:26:58.329875 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-6fdc97cc-1a49-48c5-add0-fac14256aaeb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1666 microversion: 2.1 time: 0.155616 Sep 21 12:26:58.330447 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 337/666] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:26:58 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1666 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:26:59.313062 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-08c4cc06-4ba8-44a6-9035-1371cd906549 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:26:59.313761 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-08c4cc06-4ba8-44a6-9035-1371cd906549 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:26:59.320623 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-08c4cc06-4ba8-44a6-9035-1371cd906549 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:59.321101 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-08c4cc06-4ba8-44a6-9035-1371cd906549 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:59.321538 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-08c4cc06-4ba8-44a6-9035-1371cd906549 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:59.322220 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-08c4cc06-4ba8-44a6-9035-1371cd906549 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:26:59.322669 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-08c4cc06-4ba8-44a6-9035-1371cd906549 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:26:59.323090 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-08c4cc06-4ba8-44a6-9035-1371cd906549 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:26:59.461082 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-08c4cc06-4ba8-44a6-9035-1371cd906549 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:26:59.469326 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-08c4cc06-4ba8-44a6-9035-1371cd906549 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1755 microversion: 2.1 time: 0.160202 Sep 21 12:26:59.469906 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 330/667] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:26:59 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:27:00.492425 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-ccc9a521-de66-49b1-919c-1894d061256b tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:00.493040 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-ccc9a521-de66-49b1-919c-1894d061256b tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:00.499494 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ccc9a521-de66-49b1-919c-1894d061256b tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:00.500016 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ccc9a521-de66-49b1-919c-1894d061256b tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:00.500459 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ccc9a521-de66-49b1-919c-1894d061256b tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:00.501637 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ccc9a521-de66-49b1-919c-1894d061256b tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:00.502091 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ccc9a521-de66-49b1-919c-1894d061256b tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:00.502515 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ccc9a521-de66-49b1-919c-1894d061256b tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:00.640612 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-ccc9a521-de66-49b1-919c-1894d061256b tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:00.644847 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:27:00.650549 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-ccc9a521-de66-49b1-919c-1894d061256b tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1755 microversion: 2.1 time: 0.161991 Sep 21 12:27:00.651121 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 338/668] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:27:00 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:27:01.674313 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-e45d2695-122a-42a2-a2c6-f3adf904f2c1 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:01.674926 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-e45d2695-122a-42a2-a2c6-f3adf904f2c1 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:01.681641 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e45d2695-122a-42a2-a2c6-f3adf904f2c1 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:01.682133 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e45d2695-122a-42a2-a2c6-f3adf904f2c1 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:01.682577 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e45d2695-122a-42a2-a2c6-f3adf904f2c1 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:01.683281 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e45d2695-122a-42a2-a2c6-f3adf904f2c1 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:01.683741 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e45d2695-122a-42a2-a2c6-f3adf904f2c1 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:01.684198 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e45d2695-122a-42a2-a2c6-f3adf904f2c1 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:01.830196 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-e45d2695-122a-42a2-a2c6-f3adf904f2c1 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:01.838321 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-e45d2695-122a-42a2-a2c6-f3adf904f2c1 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1755 microversion: 2.1 time: 0.167936 Sep 21 12:27:01.838910 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 331/669] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:27:01 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:27:02.863276 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-2f98b586-6dd6-4c32-86b1-2ea70640828e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:02.863892 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-2f98b586-6dd6-4c32-86b1-2ea70640828e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:02.870829 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2f98b586-6dd6-4c32-86b1-2ea70640828e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:02.871313 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2f98b586-6dd6-4c32-86b1-2ea70640828e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:02.871745 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2f98b586-6dd6-4c32-86b1-2ea70640828e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:02.872468 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2f98b586-6dd6-4c32-86b1-2ea70640828e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:02.872914 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2f98b586-6dd6-4c32-86b1-2ea70640828e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:02.873332 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2f98b586-6dd6-4c32-86b1-2ea70640828e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:03.011933 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-2f98b586-6dd6-4c32-86b1-2ea70640828e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:03.020617 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-2f98b586-6dd6-4c32-86b1-2ea70640828e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1758 microversion: 2.1 time: 0.162009 Sep 21 12:27:03.021260 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 339/670] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:27:02 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:27:04.075938 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-b1062dc3-21d0-44fb-a4f6-7f928e6284e4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ecc73aa7-7c05-45d1-9559-ccffa3dfb570"}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:27:04.078668 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-b1062dc3-21d0-44fb-a4f6-7f928e6284e4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:04.085105 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b1062dc3-21d0-44fb-a4f6-7f928e6284e4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:04.085590 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b1062dc3-21d0-44fb-a4f6-7f928e6284e4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:04.086025 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b1062dc3-21d0-44fb-a4f6-7f928e6284e4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:04.086717 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b1062dc3-21d0-44fb-a4f6-7f928e6284e4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:04.087174 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b1062dc3-21d0-44fb-a4f6-7f928e6284e4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:04.087609 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b1062dc3-21d0-44fb-a4f6-7f928e6284e4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:04.337629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:27:04.361466 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-b1062dc3-21d0-44fb-a4f6-7f928e6284e4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "POST /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288662 Sep 21 12:27:04.362144 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 332/671] 10.222.0.71 () {60 vars in 1323 bytes} [Wed Sep 21 12:27:04 2022] POST /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:27:08.510475 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-37762d22-b141-469c-9a55-76ec61ae663f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:08.511048 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-37762d22-b141-469c-9a55-76ec61ae663f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:08.517653 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-37762d22-b141-469c-9a55-76ec61ae663f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:08.518203 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-37762d22-b141-469c-9a55-76ec61ae663f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:08.518649 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-37762d22-b141-469c-9a55-76ec61ae663f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:08.519341 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-37762d22-b141-469c-9a55-76ec61ae663f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:08.519824 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-37762d22-b141-469c-9a55-76ec61ae663f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:08.520255 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-37762d22-b141-469c-9a55-76ec61ae663f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:08.549066 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-37762d22-b141-469c-9a55-76ec61ae663f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e/os-volume_attachments/935e185f-4654-4eff-98f6-ae976c584203" status: 200 len: 194 microversion: 2.20 time: 0.042592 Sep 21 12:27:08.549652 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 340/672] 10.222.0.71 () {60 vars in 1454 bytes} [Wed Sep 21 12:27:08 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e/os-volume_attachments/935e185f-4654-4eff-98f6-ae976c584203 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 12:27:08.619859 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-36a5db7d-1991-4db2-b240-2add208890a0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:08.620455 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-36a5db7d-1991-4db2-b240-2add208890a0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:08.626827 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-36a5db7d-1991-4db2-b240-2add208890a0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:08.627333 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-36a5db7d-1991-4db2-b240-2add208890a0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:08.627795 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-36a5db7d-1991-4db2-b240-2add208890a0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:08.628494 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-36a5db7d-1991-4db2-b240-2add208890a0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:08.628950 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-36a5db7d-1991-4db2-b240-2add208890a0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:08.629380 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-36a5db7d-1991-4db2-b240-2add208890a0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:08.761379 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.objects.instance [None req-36a5db7d-1991-4db2-b240-2add208890a0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lazy-loading 'services' on Instance uuid 5e9ebd08-4c95-43f6-a1a4-3268532d961e {{(pid=120463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 12:27:08.877863 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-36a5db7d-1991-4db2-b240-2add208890a0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "DELETE /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e/os-volume_attachments/935e185f-4654-4eff-98f6-ae976c584203" status: 202 len: 0 microversion: 2.20 time: 0.262843 Sep 21 12:27:08.878457 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 333/673] 10.222.0.71 () {60 vars in 1457 bytes} [Wed Sep 21 12:27:08 2022] DELETE /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e/os-volume_attachments/935e185f-4654-4eff-98f6-ae976c584203 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 21 12:27:08.887100 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-9aea1ee5-bfd4-46ed-94a3-f2e7baccfe23 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:08.889385 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-9aea1ee5-bfd4-46ed-94a3-f2e7baccfe23 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:08.895996 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9aea1ee5-bfd4-46ed-94a3-f2e7baccfe23 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:08.896406 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9aea1ee5-bfd4-46ed-94a3-f2e7baccfe23 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:08.897464 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9aea1ee5-bfd4-46ed-94a3-f2e7baccfe23 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:08.897625 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9aea1ee5-bfd4-46ed-94a3-f2e7baccfe23 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:08.898136 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9aea1ee5-bfd4-46ed-94a3-f2e7baccfe23 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:08.898567 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9aea1ee5-bfd4-46ed-94a3-f2e7baccfe23 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:08.931529 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-9aea1ee5-bfd4-46ed-94a3-f2e7baccfe23 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048445 Sep 21 12:27:08.932154 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 341/674] 10.222.0.71 () {60 vars in 1343 bytes} [Wed Sep 21 12:27:08 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 12:27:09.946435 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-161b4f40-fb72-45c4-b6b4-e5f9133011e1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:09.948844 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-161b4f40-fb72-45c4-b6b4-e5f9133011e1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:09.955707 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-161b4f40-fb72-45c4-b6b4-e5f9133011e1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:09.956229 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-161b4f40-fb72-45c4-b6b4-e5f9133011e1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:09.956692 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-161b4f40-fb72-45c4-b6b4-e5f9133011e1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:09.957389 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-161b4f40-fb72-45c4-b6b4-e5f9133011e1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:09.957847 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-161b4f40-fb72-45c4-b6b4-e5f9133011e1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:09.958271 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-161b4f40-fb72-45c4-b6b4-e5f9133011e1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:09.987918 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-161b4f40-fb72-45c4-b6b4-e5f9133011e1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046109 Sep 21 12:27:09.988491 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 334/675] 10.222.0.71 () {60 vars in 1343 bytes} [Wed Sep 21 12:27:09 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 12:27:11.001207 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-2a538e00-30d7-4602-9088-e115f3bb0ef2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:11.003477 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-2a538e00-30d7-4602-9088-e115f3bb0ef2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:11.010047 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2a538e00-30d7-4602-9088-e115f3bb0ef2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:11.010490 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2a538e00-30d7-4602-9088-e115f3bb0ef2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:11.010924 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2a538e00-30d7-4602-9088-e115f3bb0ef2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:11.011652 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2a538e00-30d7-4602-9088-e115f3bb0ef2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:11.012142 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2a538e00-30d7-4602-9088-e115f3bb0ef2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:11.012568 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2a538e00-30d7-4602-9088-e115f3bb0ef2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:11.042833 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-2a538e00-30d7-4602-9088-e115f3bb0ef2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046160 Sep 21 12:27:11.043399 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 342/676] 10.222.0.71 () {60 vars in 1343 bytes} [Wed Sep 21 12:27:10 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 12:27:11.910619 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-29d46176-3fc8-4927-b40e-9790950624d0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:27:11.912808 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-29d46176-3fc8-4927-b40e-9790950624d0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:11.919024 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-29d46176-3fc8-4927-b40e-9790950624d0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:11.919619 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-29d46176-3fc8-4927-b40e-9790950624d0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:11.920097 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-29d46176-3fc8-4927-b40e-9790950624d0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:11.920782 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-29d46176-3fc8-4927-b40e-9790950624d0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:11.921232 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-29d46176-3fc8-4927-b40e-9790950624d0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:11.921683 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-29d46176-3fc8-4927-b40e-9790950624d0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:11.944046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.objects.instance [None req-29d46176-3fc8-4927-b40e-9790950624d0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lazy-loading 'flavor' on Instance uuid 5f4f10b5-8953-4c76-a286-6974d7c88433 {{(pid=120463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 12:27:12.054839 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-b81b48a2-620d-4c6a-add6-a43c40d6df6f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:12.057303 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-b81b48a2-620d-4c6a-add6-a43c40d6df6f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:12.063583 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b81b48a2-620d-4c6a-add6-a43c40d6df6f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:12.064091 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b81b48a2-620d-4c6a-add6-a43c40d6df6f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:12.064531 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b81b48a2-620d-4c6a-add6-a43c40d6df6f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:12.065234 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b81b48a2-620d-4c6a-add6-a43c40d6df6f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:12.065690 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b81b48a2-620d-4c6a-add6-a43c40d6df6f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:12.066115 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b81b48a2-620d-4c6a-add6-a43c40d6df6f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:12.070833 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-29d46176-3fc8-4927-b40e-9790950624d0 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "POST /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433/action" status: 200 len: 32 microversion: 2.1 time: 0.164677 Sep 21 12:27:12.071630 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 335/677] 10.222.0.71 () {60 vars in 1278 bytes} [Wed Sep 21 12:27:11 2022] POST /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433/action => generated 32 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 21 12:27:12.082514 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-8d18bbe4-0245-4d8c-83ba-2a6ed15cb397 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:12.083467 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-8d18bbe4-0245-4d8c-83ba-2a6ed15cb397 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:12.089942 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8d18bbe4-0245-4d8c-83ba-2a6ed15cb397 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:12.090662 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8d18bbe4-0245-4d8c-83ba-2a6ed15cb397 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:12.091618 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8d18bbe4-0245-4d8c-83ba-2a6ed15cb397 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:12.092297 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8d18bbe4-0245-4d8c-83ba-2a6ed15cb397 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:12.092845 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8d18bbe4-0245-4d8c-83ba-2a6ed15cb397 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:12.093437 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8d18bbe4-0245-4d8c-83ba-2a6ed15cb397 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:12.099311 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-b81b48a2-620d-4c6a-add6-a43c40d6df6f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048489 Sep 21 12:27:12.099939 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 343/678] 10.222.0.71 () {60 vars in 1343 bytes} [Wed Sep 21 12:27:12 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 12:27:12.229056 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-8d18bbe4-0245-4d8c-83ba-2a6ed15cb397 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:12.237862 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-8d18bbe4-0245-4d8c-83ba-2a6ed15cb397 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1734 microversion: 2.1 time: 0.160276 Sep 21 12:27:12.238606 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 336/679] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:27:12 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:27:13.113441 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-0fd72d34-5697-4bc4-a4d7-3b35b7f10a57 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:13.115567 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-0fd72d34-5697-4bc4-a4d7-3b35b7f10a57 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:13.121990 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0fd72d34-5697-4bc4-a4d7-3b35b7f10a57 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:13.122478 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0fd72d34-5697-4bc4-a4d7-3b35b7f10a57 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:13.122913 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0fd72d34-5697-4bc4-a4d7-3b35b7f10a57 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:13.123608 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0fd72d34-5697-4bc4-a4d7-3b35b7f10a57 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:13.124093 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0fd72d34-5697-4bc4-a4d7-3b35b7f10a57 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:13.124522 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0fd72d34-5697-4bc4-a4d7-3b35b7f10a57 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:13.152678 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-0fd72d34-5697-4bc4-a4d7-3b35b7f10a57 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043804 Sep 21 12:27:13.153237 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 344/680] 10.222.0.71 () {60 vars in 1343 bytes} [Wed Sep 21 12:27:13 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:27:13.216000 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-ade80029-7867-4191-bb6a-3e8083e8d86e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:13.216513 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-ade80029-7867-4191-bb6a-3e8083e8d86e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:13.223325 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ade80029-7867-4191-bb6a-3e8083e8d86e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:13.223842 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ade80029-7867-4191-bb6a-3e8083e8d86e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:13.224285 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ade80029-7867-4191-bb6a-3e8083e8d86e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:13.224982 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ade80029-7867-4191-bb6a-3e8083e8d86e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:13.225447 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ade80029-7867-4191-bb6a-3e8083e8d86e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:13.225882 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ade80029-7867-4191-bb6a-3e8083e8d86e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:13.250864 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-ade80029-7867-4191-bb6a-3e8083e8d86e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Going to try to terminate instance {{(pid=120463) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 12:27:13.264639 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-4c70a1e8-5f34-4e97-a444-75a8db93ca14 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:13.265256 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-4c70a1e8-5f34-4e97-a444-75a8db93ca14 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:13.271144 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4c70a1e8-5f34-4e97-a444-75a8db93ca14 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:13.271627 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4c70a1e8-5f34-4e97-a444-75a8db93ca14 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:13.272107 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4c70a1e8-5f34-4e97-a444-75a8db93ca14 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:13.272808 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4c70a1e8-5f34-4e97-a444-75a8db93ca14 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:13.273268 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4c70a1e8-5f34-4e97-a444-75a8db93ca14 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:13.273698 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4c70a1e8-5f34-4e97-a444-75a8db93ca14 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:13.335447 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-ade80029-7867-4191-bb6a-3e8083e8d86e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "DELETE /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 204 len: 0 microversion: 2.20 time: 0.122872 Sep 21 12:27:13.336125 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 337/681] 10.222.0.71 () {60 vars in 1280 bytes} [Wed Sep 21 12:27:13 2022] DELETE /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 21 12:27:13.346214 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-a1be4540-bd97-451c-9e15-f6a92927f90e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:13.346917 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-a1be4540-bd97-451c-9e15-f6a92927f90e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:13.352926 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a1be4540-bd97-451c-9e15-f6a92927f90e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:13.353423 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a1be4540-bd97-451c-9e15-f6a92927f90e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:13.353867 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a1be4540-bd97-451c-9e15-f6a92927f90e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:13.354578 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a1be4540-bd97-451c-9e15-f6a92927f90e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:13.355040 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a1be4540-bd97-451c-9e15-f6a92927f90e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:13.355476 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a1be4540-bd97-451c-9e15-f6a92927f90e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:13.413364 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-4c70a1e8-5f34-4e97-a444-75a8db93ca14 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:13.421823 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-4c70a1e8-5f34-4e97-a444-75a8db93ca14 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1734 microversion: 2.1 time: 0.160967 Sep 21 12:27:13.423075 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 345/682] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:27:13 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:27:13.488740 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a1be4540-bd97-451c-9e15-f6a92927f90e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:13.496903 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a1be4540-bd97-451c-9e15-f6a92927f90e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:13.498405 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a1be4540-bd97-451c-9e15-f6a92927f90e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:13.499574 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-a1be4540-bd97-451c-9e15-f6a92927f90e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1725 microversion: 2.20 time: 0.158377 Sep 21 12:27:13.500219 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 338/683] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:27:13 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:27:14.445547 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-f07a764f-4f3a-48ac-a84a-b5eeb7bb7ec7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:14.446159 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-f07a764f-4f3a-48ac-a84a-b5eeb7bb7ec7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:14.448472 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_api:SELECT=43 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:27:14.454217 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f07a764f-4f3a-48ac-a84a-b5eeb7bb7ec7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:14.454703 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f07a764f-4f3a-48ac-a84a-b5eeb7bb7ec7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:14.455143 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f07a764f-4f3a-48ac-a84a-b5eeb7bb7ec7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:14.455866 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f07a764f-4f3a-48ac-a84a-b5eeb7bb7ec7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:14.456329 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f07a764f-4f3a-48ac-a84a-b5eeb7bb7ec7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:14.456759 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f07a764f-4f3a-48ac-a84a-b5eeb7bb7ec7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:14.525524 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-47bfb716-32f8-48e9-ace9-77480a6397c3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:14.526361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-47bfb716-32f8-48e9-ace9-77480a6397c3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:14.532952 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-47bfb716-32f8-48e9-ace9-77480a6397c3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:14.533488 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-47bfb716-32f8-48e9-ace9-77480a6397c3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:14.533943 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-47bfb716-32f8-48e9-ace9-77480a6397c3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:14.534647 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-47bfb716-32f8-48e9-ace9-77480a6397c3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:14.535109 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-47bfb716-32f8-48e9-ace9-77480a6397c3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:14.535541 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-47bfb716-32f8-48e9-ace9-77480a6397c3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:14.584382 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-f07a764f-4f3a-48ac-a84a-b5eeb7bb7ec7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:14.592527 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-f07a764f-4f3a-48ac-a84a-b5eeb7bb7ec7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1734 microversion: 2.1 time: 0.150814 Sep 21 12:27:14.593104 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 346/684] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:27:14 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:27:14.663467 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-47bfb716-32f8-48e9-ace9-77480a6397c3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:14.671433 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-47bfb716-32f8-48e9-ace9-77480a6397c3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:14.673585 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-47bfb716-32f8-48e9-ace9-77480a6397c3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:14.674748 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-47bfb716-32f8-48e9-ace9-77480a6397c3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1725 microversion: 2.20 time: 0.153157 Sep 21 12:27:14.675310 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 339/685] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:27:14 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:27:15.616815 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-2322eaec-0feb-4a02-b618-6912d67dfdb6 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:15.617282 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-2322eaec-0feb-4a02-b618-6912d67dfdb6 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:15.624260 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2322eaec-0feb-4a02-b618-6912d67dfdb6 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:15.624750 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2322eaec-0feb-4a02-b618-6912d67dfdb6 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:15.625699 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2322eaec-0feb-4a02-b618-6912d67dfdb6 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:15.626429 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2322eaec-0feb-4a02-b618-6912d67dfdb6 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:15.626889 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2322eaec-0feb-4a02-b618-6912d67dfdb6 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:15.627319 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2322eaec-0feb-4a02-b618-6912d67dfdb6 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:15.699963 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-c486d218-cb96-4e48-8665-cfc4d8f16594 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:15.700590 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-c486d218-cb96-4e48-8665-cfc4d8f16594 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:15.703298 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:27:15.710291 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c486d218-cb96-4e48-8665-cfc4d8f16594 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:15.710784 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c486d218-cb96-4e48-8665-cfc4d8f16594 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:15.711227 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c486d218-cb96-4e48-8665-cfc4d8f16594 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:15.711963 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c486d218-cb96-4e48-8665-cfc4d8f16594 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:15.712427 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c486d218-cb96-4e48-8665-cfc4d8f16594 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:15.712858 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c486d218-cb96-4e48-8665-cfc4d8f16594 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:15.792791 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-2322eaec-0feb-4a02-b618-6912d67dfdb6 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:15.802154 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-2322eaec-0feb-4a02-b618-6912d67dfdb6 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1734 microversion: 2.1 time: 0.189698 Sep 21 12:27:15.811804 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 347/686] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:27:15 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1734 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:27:15.849242 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-c486d218-cb96-4e48-8665-cfc4d8f16594 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:15.857494 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-c486d218-cb96-4e48-8665-cfc4d8f16594 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:15.859036 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-c486d218-cb96-4e48-8665-cfc4d8f16594 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:15.860797 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-c486d218-cb96-4e48-8665-cfc4d8f16594 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1725 microversion: 2.20 time: 0.164850 Sep 21 12:27:15.861454 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 340/687] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:27:15 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:27:16.700250 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-182ba577-3ebb-436d-a5d0-4a8db9bab87d req-e407ad8a-f8b9-4121-84ac-2edb1b919025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e9ebd08-4c95-43f6-a1a4-3268532d961e", "name": "network-vif-deleted", "tag": "1f39c2aa-a245-4b77-8233-20f0c6c6cb30"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:27:16.712773 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-182ba577-3ebb-436d-a5d0-4a8db9bab87d req-e407ad8a-f8b9-4121-84ac-2edb1b919025 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:16.713250 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-182ba577-3ebb-436d-a5d0-4a8db9bab87d req-e407ad8a-f8b9-4121-84ac-2edb1b919025 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:16.713675 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-182ba577-3ebb-436d-a5d0-4a8db9bab87d req-e407ad8a-f8b9-4121-84ac-2edb1b919025 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:16.726066 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-182ba577-3ebb-436d-a5d0-4a8db9bab87d req-e407ad8a-f8b9-4121-84ac-2edb1b919025 service nova] Creating event network-vif-deleted:1f39c2aa-a245-4b77-8233-20f0c6c6cb30 for instance 5e9ebd08-4c95-43f6-a1a4-3268532d961e on hv-cinder-85867 Sep 21 12:27:16.732760 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-182ba577-3ebb-436d-a5d0-4a8db9bab87d req-e407ad8a-f8b9-4121-84ac-2edb1b919025 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095297 Sep 21 12:27:16.733771 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 348/688] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:27:16.826528 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-19f16528-7921-440e-b923-6f1c7be6ba95 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:16.827261 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-19f16528-7921-440e-b923-6f1c7be6ba95 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:16.834781 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-19f16528-7921-440e-b923-6f1c7be6ba95 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:16.835436 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-19f16528-7921-440e-b923-6f1c7be6ba95 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:16.836004 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-19f16528-7921-440e-b923-6f1c7be6ba95 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:16.836799 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-19f16528-7921-440e-b923-6f1c7be6ba95 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:16.837374 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-19f16528-7921-440e-b923-6f1c7be6ba95 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:16.837933 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-19f16528-7921-440e-b923-6f1c7be6ba95 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:16.887097 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-8ff2b740-532c-405b-a8f6-d2d3fcc07f4b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:16.887938 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-8ff2b740-532c-405b-a8f6-d2d3fcc07f4b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:16.896989 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8ff2b740-532c-405b-a8f6-d2d3fcc07f4b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:16.897486 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8ff2b740-532c-405b-a8f6-d2d3fcc07f4b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:16.902209 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8ff2b740-532c-405b-a8f6-d2d3fcc07f4b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:16.902972 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8ff2b740-532c-405b-a8f6-d2d3fcc07f4b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:16.903463 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8ff2b740-532c-405b-a8f6-d2d3fcc07f4b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:16.903924 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8ff2b740-532c-405b-a8f6-d2d3fcc07f4b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:16.960455 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8ff2b740-532c-405b-a8f6-d2d3fcc07f4b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:16.961108 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8ff2b740-532c-405b-a8f6-d2d3fcc07f4b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:16.961775 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8ff2b740-532c-405b-a8f6-d2d3fcc07f4b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:16.962555 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.objects.instance [None req-8ff2b740-532c-405b-a8f6-d2d3fcc07f4b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lazy-loading 'fault' on Instance uuid 5e9ebd08-4c95-43f6-a1a4-3268532d961e {{(pid=120462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 12:27:16.987590 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-19f16528-7921-440e-b923-6f1c7be6ba95 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:16.996968 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-19f16528-7921-440e-b923-6f1c7be6ba95 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1734 microversion: 2.1 time: 0.174598 Sep 21 12:27:17.000619 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 341/689] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:27:16 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:27:17.010316 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-8ff2b740-532c-405b-a8f6-d2d3fcc07f4b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:17.024115 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-8ff2b740-532c-405b-a8f6-d2d3fcc07f4b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:17.025667 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-8ff2b740-532c-405b-a8f6-d2d3fcc07f4b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:17.026915 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-8ff2b740-532c-405b-a8f6-d2d3fcc07f4b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 200 len: 1371 microversion: 2.20 time: 0.144123 Sep 21 12:27:17.027710 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 349/690] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:27:16 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 1371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:27:18.022087 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-2ec8365a-8cba-4f33-851c-826ae783d2eb tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:18.022626 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-2ec8365a-8cba-4f33-851c-826ae783d2eb tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:18.029120 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2ec8365a-8cba-4f33-851c-826ae783d2eb tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:18.029612 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2ec8365a-8cba-4f33-851c-826ae783d2eb tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:18.030056 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2ec8365a-8cba-4f33-851c-826ae783d2eb tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:18.030751 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2ec8365a-8cba-4f33-851c-826ae783d2eb tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:18.031843 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2ec8365a-8cba-4f33-851c-826ae783d2eb tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:18.032289 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2ec8365a-8cba-4f33-851c-826ae783d2eb tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:18.052404 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-213ae4b1-7f66-4fbf-9003-6d198bc93c8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:18.053013 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-213ae4b1-7f66-4fbf-9003-6d198bc93c8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:18.059327 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-213ae4b1-7f66-4fbf-9003-6d198bc93c8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:18.059844 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-213ae4b1-7f66-4fbf-9003-6d198bc93c8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:18.060289 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-213ae4b1-7f66-4fbf-9003-6d198bc93c8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:18.061050 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-213ae4b1-7f66-4fbf-9003-6d198bc93c8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:18.061516 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-213ae4b1-7f66-4fbf-9003-6d198bc93c8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:18.061980 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-213ae4b1-7f66-4fbf-9003-6d198bc93c8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:18.076203 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.wsgi [None req-213ae4b1-7f66-4fbf-9003-6d198bc93c8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] HTTP exception thrown: Instance 5e9ebd08-4c95-43f6-a1a4-3268532d961e could not be found. Sep 21 12:27:18.077916 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-213ae4b1-7f66-4fbf-9003-6d198bc93c8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Request method failure captured: Sep 21 12:27:18.077916 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: request: GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e HTTP/1.1 Sep 21 12:27:18.077916 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept: application/json Sep 21 12:27:18.077916 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept-Encoding: identity Sep 21 12:27:18.077916 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Connection: close Sep 21 12:27:18.077916 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Length: 0 Sep 21 12:27:18.077916 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Type: application/json Sep 21 12:27:18.077916 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Host: 10.222.0.71 Sep 21 12:27:18.077916 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Openstack-System-Scope: None Sep 21 12:27:18.077916 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: User-Agent: python-urllib3/1.26.12 Sep 21 12:27:18.077916 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Auth-Token: gAAAAABjKwGi765GAFYA3IAKFcWIzHlC3VCdSEJQ0LsJLWNpr3tTSZGFpuAcEoMVayL0ParxzyNUGFtkK_zpkCauPpiwRc4rVxqR8H6tY5vo-giGXrN6-SEFIgZJqx7d8Xzea8SjUtn7yVuQq51nW7iCSPOm2XM5i8hp4ouwL1pPDADviimkmxA Sep 21 12:27:18.077916 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Id: None Sep 21 12:27:18.077916 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Name: None Sep 21 12:27:18.077916 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Identity-Status: Confirmed Sep 21 12:27:18.077916 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Is-Admin-Project: True Sep 21 12:27:18.077916 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Openstack-Nova-Api-Version: 2.20 Sep 21 12:27:18.077916 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Id: default Sep 21 12:27:18.077916 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Name: Default Sep 21 12:27:18.077916 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Id: 5e6ef4f3de1943ffbde82d3f0a19542f Sep 21 12:27:18.077916 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1081637862 Sep 21 12:27:18.077916 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Role: reader,member Sep 21 12:27:18.077916 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Roles: reader,member Sep 21 12:27:18.080154 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/5e6ef4f3de1943ffbde82d3f0a19542f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/5e6ef4f3de1943ffbde82d3f0a19542f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_5e6ef4f3de1943ffbde82d3f0a19542f", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/5e6ef4f3de1943ffbde82d3f0a19542f"}]}] Sep 21 12:27:18.080154 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1081637862 Sep 21 12:27:18.080154 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Id: 5e6ef4f3de1943ffbde82d3f0a19542f Sep 21 12:27:18.080154 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1081637862 Sep 21 12:27:18.080154 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User: tempest-AttachVolumeShelveTestJSON-1081637862-project Sep 21 12:27:18.080154 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Id: default Sep 21 12:27:18.080154 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Name: Default Sep 21 12:27:18.080154 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Id: c950eb00b9474b29b86d24983e3b1583 Sep 21 12:27:18.080154 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1081637862-project Sep 21 12:27:18.080154 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: method: > Sep 21 12:27:18.080154 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: exception: Instance 5e9ebd08-4c95-43f6-a1a4-3268532d961e could not be found. Sep 21 12:27:18.080154 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: action_args: {'id': '5e9ebd08-4c95-43f6-a1a4-3268532d961e'} Sep 21 12:27:18.081219 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:27:18.081219 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:27:18.081219 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:27:18.081219 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:27:18.081219 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:27:18.081219 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:27:18.081219 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:27:18.081219 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:27:18.081219 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:27:18.081219 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:27:18.081219 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e9ebd08-4c95-43f6-a1a4-3268532d961e could not be found. Sep 21 12:27:18.081219 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:27:18.081219 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:27:18.081219 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:27:18.081219 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:27:18.081219 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:27:18.081219 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:27:18.081219 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:27:18.081219 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:27:18.081219 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:27:18.082707 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:27:18.082707 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 12:27:18.082707 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 12:27:18.082707 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:27:18.082707 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:27:18.082707 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:27:18.082707 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:27:18.082707 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e9ebd08-4c95-43f6-a1a4-3268532d961e could not be found. Sep 21 12:27:18.082707 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:27:18.082707 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:27:18.082707 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:27:18.082707 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:27:18.082707 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:27:18.082707 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:27:18.082707 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:27:18.082707 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:27:18.082707 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e9ebd08-4c95-43f6-a1a4-3268532d961e could not be found. Sep 21 12:27:18.082707 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:27:18.084091 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-213ae4b1-7f66-4fbf-9003-6d198bc93c8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Returning 404 to user: Instance 5e9ebd08-4c95-43f6-a1a4-3268532d961e could not be found. {{(pid=120462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:27:18.084091 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-213ae4b1-7f66-4fbf-9003-6d198bc93c8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 404 len: 111 microversion: 2.20 time: 0.031239 Sep 21 12:27:18.084091 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 350/691] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:27:18 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 21 12:27:18.088494 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-ca8a4a26-74b9-459e-a7e9-fdc139c7f530 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '.version_select at 0x7fe4c905f3a0>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:18.092959 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ca8a4a26-74b9-459e-a7e9-fdc139c7f530 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [cfaf2f38-233c-44fd-b6de-37696c6073a3] AMQP server on 10.222.0.71:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 21 12:27:18.166785 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-2ec8365a-8cba-4f33-851c-826ae783d2eb tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:18.175094 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-2ec8365a-8cba-4f33-851c-826ae783d2eb tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1734 microversion: 2.1 time: 0.157023 Sep 21 12:27:18.175669 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 342/692] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:27:18 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:27:19.100648 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO oslo.messaging._drivers.impl_rabbit [None req-ca8a4a26-74b9-459e-a7e9-fdc139c7f530 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [cfaf2f38-233c-44fd-b6de-37696c6073a3] Reconnected to AMQP server on 10.222.0.71:5672 via [amqp] client with port 41948. Sep 21 12:27:19.120377 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-ca8a4a26-74b9-459e-a7e9-fdc139c7f530 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1299598923" status: 204 len: 0 microversion: 2.20 time: 1.035364 Sep 21 12:27:19.120959 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 351/693] 10.222.0.71 () {60 vars in 1262 bytes} [Wed Sep 21 12:27:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1299598923 => generated 0 bytes in 1037 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 21 12:27:19.198317 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-0a5c52d5-0f5f-40a0-8074-0bb1ebc384ba tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:19.198978 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-0a5c52d5-0f5f-40a0-8074-0bb1ebc384ba tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:19.206335 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0a5c52d5-0f5f-40a0-8074-0bb1ebc384ba tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:19.207069 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0a5c52d5-0f5f-40a0-8074-0bb1ebc384ba tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:19.207617 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0a5c52d5-0f5f-40a0-8074-0bb1ebc384ba tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:19.208310 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0a5c52d5-0f5f-40a0-8074-0bb1ebc384ba tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:19.208720 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0a5c52d5-0f5f-40a0-8074-0bb1ebc384ba tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:19.209154 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0a5c52d5-0f5f-40a0-8074-0bb1ebc384ba tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:19.381356 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-0a5c52d5-0f5f-40a0-8074-0bb1ebc384ba tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:19.390629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-0a5c52d5-0f5f-40a0-8074-0bb1ebc384ba tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1734 microversion: 2.1 time: 0.196178 Sep 21 12:27:19.391211 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 343/694] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:27:19 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1734 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:27:19.803484 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-d2e839a5-2529-4193-9f2d-75e1a2211ced tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Action: 'create', calling method: .version_select at 0x7fe4cc70e9d0>, body: {"keypair": {"name": "tempest-keypair-100653391", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUUVp1RQAyJ+pGzUVstsNVZHNJaojLy5DYtQKoItiNhKAj3RC2OZ7rZS/8WAj0G7XyDQHmW2nYeTc5gCSFbyvyIy9fi4b8d+NO93aIJqzWUSf50Ewl6H7zz81ONy1AvaA=="}} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:27:19.819432 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-d2e839a5-2529-4193-9f2d-75e1a2211ced tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Getting quotas for project 5e6ef4f3de1943ffbde82d3f0a19542f. Resources: {'key_pairs'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 12:27:19.823284 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-d2e839a5-2529-4193-9f2d-75e1a2211ced tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Getting quotas for user c950eb00b9474b29b86d24983e3b1583 and project 5e6ef4f3de1943ffbde82d3f0a19542f. Resources: {'key_pairs'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 12:27:19.846254 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-d2e839a5-2529-4193-9f2d-75e1a2211ced tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.046706 Sep 21 12:27:19.847040 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 352/695] 10.222.0.71 () {62 vars in 1200 bytes} [Wed Sep 21 12:27:19 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 21 12:27:20.416346 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-16318b60-4d94-4d73-bb9d-69bf90bc935f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:20.419341 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-16318b60-4d94-4d73-bb9d-69bf90bc935f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:20.426933 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-16318b60-4d94-4d73-bb9d-69bf90bc935f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:20.426933 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-16318b60-4d94-4d73-bb9d-69bf90bc935f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:20.427249 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-16318b60-4d94-4d73-bb9d-69bf90bc935f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:20.428176 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-16318b60-4d94-4d73-bb9d-69bf90bc935f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:20.428595 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-16318b60-4d94-4d73-bb9d-69bf90bc935f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:20.429030 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-16318b60-4d94-4d73-bb9d-69bf90bc935f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:20.447960 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=92,nova_cell1:INSERT=4 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:27:20.565221 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-16318b60-4d94-4d73-bb9d-69bf90bc935f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:20.573822 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-16318b60-4d94-4d73-bb9d-69bf90bc935f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1734 microversion: 2.1 time: 0.163298 Sep 21 12:27:20.574413 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 344/696] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:27:20 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:27:21.313731 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-f93d4644-4de4-4a9a-81d9-f31b13fc5fd9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-780968980", "imageRef": "1e3a8d95-6338-499c-af91-e3d1345af950", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b3f0e30c-c130-4bd6-a99c-2726089c3f25"}], "security_groups": [{"name": "tempest-securitygroup--843480151"}], "key_name": "tempest-keypair-100653391", "user_data": "}} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:27:21.417268 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.network.neutron [None req-f93d4644-4de4-4a9a-81d9-f31b13fc5fd9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] validate_networks() for [('b3f0e30c-c130-4bd6-a99c-2726089c3f25', None, None, None, None, None)] {{(pid=120462) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 12:27:21.596715 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-1943c936-b2a8-4129-8482-b296ec2bf36b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:21.597355 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-1943c936-b2a8-4129-8482-b296ec2bf36b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:21.603588 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1943c936-b2a8-4129-8482-b296ec2bf36b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:21.604635 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1943c936-b2a8-4129-8482-b296ec2bf36b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:21.604635 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1943c936-b2a8-4129-8482-b296ec2bf36b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:21.605222 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1943c936-b2a8-4129-8482-b296ec2bf36b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:21.605666 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1943c936-b2a8-4129-8482-b296ec2bf36b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:21.606088 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1943c936-b2a8-4129-8482-b296ec2bf36b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:21.738874 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-1943c936-b2a8-4129-8482-b296ec2bf36b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:21.748677 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-1943c936-b2a8-4129-8482-b296ec2bf36b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1734 microversion: 2.1 time: 0.155767 Sep 21 12:27:21.749271 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 345/697] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:27:21 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:27:21.838398 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-f93d4644-4de4-4a9a-81d9-f31b13fc5fd9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Flavor limits 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 12:27:21.838826 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-f93d4644-4de4-4a9a-81d9-f31b13fc5fd9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Image limits 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 12:27:21.839306 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-f93d4644-4de4-4a9a-81d9-f31b13fc5fd9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Flavor pref 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 12:27:21.839778 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-f93d4644-4de4-4a9a-81d9-f31b13fc5fd9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Image pref 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 12:27:21.840192 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-f93d4644-4de4-4a9a-81d9-f31b13fc5fd9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 12:27:21.848896 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f93d4644-4de4-4a9a-81d9-f31b13fc5fd9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:21.849378 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f93d4644-4de4-4a9a-81d9-f31b13fc5fd9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:21.849818 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f93d4644-4de4-4a9a-81d9-f31b13fc5fd9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:21.850550 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f93d4644-4de4-4a9a-81d9-f31b13fc5fd9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:21.851008 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f93d4644-4de4-4a9a-81d9-f31b13fc5fd9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:21.851438 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f93d4644-4de4-4a9a-81d9-f31b13fc5fd9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:21.869105 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-f93d4644-4de4-4a9a-81d9-f31b13fc5fd9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Getting quotas for project 5e6ef4f3de1943ffbde82d3f0a19542f. Resources: {'instances', 'ram', 'cores'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 12:27:21.873182 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-f93d4644-4de4-4a9a-81d9-f31b13fc5fd9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Getting quotas for user c950eb00b9474b29b86d24983e3b1583 and project 5e6ef4f3de1943ffbde82d3f0a19542f. Resources: {'instances', 'ram', 'cores'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 12:27:21.884876 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-f93d4644-4de4-4a9a-81d9-f31b13fc5fd9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Going to run 1 instances... {{(pid=120462) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 12:27:21.887176 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-f93d4644-4de4-4a9a-81d9-f31b13fc5fd9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e3a8d95-6338-499c-af91-e3d1345af950',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 12:27:21.934705 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-f93d4644-4de4-4a9a-81d9-f31b13fc5fd9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.626168 Sep 21 12:27:21.935351 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 353/698] 10.222.0.71 () {62 vars in 1188 bytes} [Wed Sep 21 12:27:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 21 12:27:21.946937 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-c692ea9f-ac53-450a-bb09-58405af7d8d0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:21.947784 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-c692ea9f-ac53-450a-bb09-58405af7d8d0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:22.001601 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-c692ea9f-ac53-450a-bb09-58405af7d8d0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:22.008910 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-c692ea9f-ac53-450a-bb09-58405af7d8d0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:22.010372 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-c692ea9f-ac53-450a-bb09-58405af7d8d0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:22.011484 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-c692ea9f-ac53-450a-bb09-58405af7d8d0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1280 microversion: 2.20 time: 0.068405 Sep 21 12:27:22.012162 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 346/699] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:27:21 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1280 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:27:22.774274 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-4d1101cf-f807-4880-a08e-6f6b81558cef tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:22.774887 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-4d1101cf-f807-4880-a08e-6f6b81558cef tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:22.781623 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4d1101cf-f807-4880-a08e-6f6b81558cef tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:22.782736 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4d1101cf-f807-4880-a08e-6f6b81558cef tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:22.783406 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4d1101cf-f807-4880-a08e-6f6b81558cef tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:22.784281 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4d1101cf-f807-4880-a08e-6f6b81558cef tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:22.784719 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4d1101cf-f807-4880-a08e-6f6b81558cef tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:22.785161 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4d1101cf-f807-4880-a08e-6f6b81558cef tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:22.923528 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-4d1101cf-f807-4880-a08e-6f6b81558cef tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:22.931911 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-4d1101cf-f807-4880-a08e-6f6b81558cef tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1734 microversion: 2.1 time: 0.162015 Sep 21 12:27:22.932481 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 354/700] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:27:22 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:27:23.036539 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-9bbdbe91-76a6-431b-90c5-3a3e33e44ee3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:23.037082 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-9bbdbe91-76a6-431b-90c5-3a3e33e44ee3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:23.043465 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9bbdbe91-76a6-431b-90c5-3a3e33e44ee3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:23.044024 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9bbdbe91-76a6-431b-90c5-3a3e33e44ee3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:23.044470 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9bbdbe91-76a6-431b-90c5-3a3e33e44ee3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:23.045164 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9bbdbe91-76a6-431b-90c5-3a3e33e44ee3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:23.045646 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9bbdbe91-76a6-431b-90c5-3a3e33e44ee3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:23.046075 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9bbdbe91-76a6-431b-90c5-3a3e33e44ee3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:23.109992 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-9bbdbe91-76a6-431b-90c5-3a3e33e44ee3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:23.121967 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-9bbdbe91-76a6-431b-90c5-3a3e33e44ee3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:23.123448 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-9bbdbe91-76a6-431b-90c5-3a3e33e44ee3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:23.125078 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-9bbdbe91-76a6-431b-90c5-3a3e33e44ee3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1332 microversion: 2.20 time: 0.092316 Sep 21 12:27:23.126626 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 347/701] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:27:23 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1332 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:27:23.956494 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-63edb186-bfd2-45be-877c-c913f71af62c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:23.957222 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-63edb186-bfd2-45be-877c-c913f71af62c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:23.963719 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-63edb186-bfd2-45be-877c-c913f71af62c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:23.964169 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-63edb186-bfd2-45be-877c-c913f71af62c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:23.964609 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-63edb186-bfd2-45be-877c-c913f71af62c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:23.965357 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-63edb186-bfd2-45be-877c-c913f71af62c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:23.965767 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-63edb186-bfd2-45be-877c-c913f71af62c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:23.966192 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-63edb186-bfd2-45be-877c-c913f71af62c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:24.153038 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-fede38c0-73c8-4374-b0a4-2ee71a92bb67 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:24.153773 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-fede38c0-73c8-4374-b0a4-2ee71a92bb67 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:24.160957 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fede38c0-73c8-4374-b0a4-2ee71a92bb67 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:24.161451 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fede38c0-73c8-4374-b0a4-2ee71a92bb67 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:24.161935 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fede38c0-73c8-4374-b0a4-2ee71a92bb67 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:24.162642 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fede38c0-73c8-4374-b0a4-2ee71a92bb67 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:24.163102 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fede38c0-73c8-4374-b0a4-2ee71a92bb67 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:24.163536 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fede38c0-73c8-4374-b0a4-2ee71a92bb67 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:24.170551 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-63edb186-bfd2-45be-877c-c913f71af62c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:24.179328 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-63edb186-bfd2-45be-877c-c913f71af62c tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1734 microversion: 2.1 time: 0.227241 Sep 21 12:27:24.180087 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 355/702] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:27:23 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1734 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:27:24.226742 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-fede38c0-73c8-4374-b0a4-2ee71a92bb67 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:24.234867 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-fede38c0-73c8-4374-b0a4-2ee71a92bb67 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:24.236380 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-fede38c0-73c8-4374-b0a4-2ee71a92bb67 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:24.237527 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-fede38c0-73c8-4374-b0a4-2ee71a92bb67 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1338 microversion: 2.20 time: 0.088943 Sep 21 12:27:24.238115 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 348/703] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:27:24 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1338 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:27:25.202189 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-7c9da6d7-d217-487b-b6ec-f5feea659bab tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:25.202800 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-7c9da6d7-d217-487b-b6ec-f5feea659bab tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:25.209241 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7c9da6d7-d217-487b-b6ec-f5feea659bab tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:25.209728 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7c9da6d7-d217-487b-b6ec-f5feea659bab tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:25.210168 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7c9da6d7-d217-487b-b6ec-f5feea659bab tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:25.210859 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7c9da6d7-d217-487b-b6ec-f5feea659bab tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:25.211343 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7c9da6d7-d217-487b-b6ec-f5feea659bab tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:25.211793 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7c9da6d7-d217-487b-b6ec-f5feea659bab tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:25.262605 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-e9b544b3-8995-4f54-893d-37f287f3dd63 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:25.263233 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-e9b544b3-8995-4f54-893d-37f287f3dd63 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:25.269871 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e9b544b3-8995-4f54-893d-37f287f3dd63 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:25.270352 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e9b544b3-8995-4f54-893d-37f287f3dd63 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:25.270815 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e9b544b3-8995-4f54-893d-37f287f3dd63 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:25.272194 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e9b544b3-8995-4f54-893d-37f287f3dd63 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:25.272649 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e9b544b3-8995-4f54-893d-37f287f3dd63 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:25.273084 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e9b544b3-8995-4f54-893d-37f287f3dd63 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:25.342569 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-7c9da6d7-d217-487b-b6ec-f5feea659bab tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:25.351445 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-7c9da6d7-d217-487b-b6ec-f5feea659bab tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1734 microversion: 2.1 time: 0.153335 Sep 21 12:27:25.352085 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 356/704] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:27:25 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:27:25.399430 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-e9b544b3-8995-4f54-893d-37f287f3dd63 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:25.408504 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-e9b544b3-8995-4f54-893d-37f287f3dd63 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:25.409958 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-e9b544b3-8995-4f54-893d-37f287f3dd63 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:25.411070 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-e9b544b3-8995-4f54-893d-37f287f3dd63 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1405 microversion: 2.20 time: 0.152502 Sep 21 12:27:25.411635 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 349/705] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:27:25 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:27:26.158998 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-9fa39ded-8225-462f-82b4-3c71b13941b4 req-4d38ef7b-5aae-46ba-8ce0-68699f8d17b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc34c677-0e22-4734-95ed-4a6834d9dc7b", "tag": "49e15f4c-39c9-4c9a-bb24-e89e5dcc9eab"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:27:26.168356 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-9fa39ded-8225-462f-82b4-3c71b13941b4 req-4d38ef7b-5aae-46ba-8ce0-68699f8d17b9 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:26.168829 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-9fa39ded-8225-462f-82b4-3c71b13941b4 req-4d38ef7b-5aae-46ba-8ce0-68699f8d17b9 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:26.169257 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-9fa39ded-8225-462f-82b4-3c71b13941b4 req-4d38ef7b-5aae-46ba-8ce0-68699f8d17b9 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:26.182608 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-9fa39ded-8225-462f-82b4-3c71b13941b4 req-4d38ef7b-5aae-46ba-8ce0-68699f8d17b9 service nova] Creating event network-changed:49e15f4c-39c9-4c9a-bb24-e89e5dcc9eab for instance dc34c677-0e22-4734-95ed-4a6834d9dc7b on hv-cinder-85867 Sep 21 12:27:26.188631 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-9fa39ded-8225-462f-82b4-3c71b13941b4 req-4d38ef7b-5aae-46ba-8ce0-68699f8d17b9 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032669 Sep 21 12:27:26.189434 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 357/706] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:27:26.374493 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-6f0c7ea1-ce5c-4b50-a91e-819573a59b96 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:26.375114 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-6f0c7ea1-ce5c-4b50-a91e-819573a59b96 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:26.382276 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6f0c7ea1-ce5c-4b50-a91e-819573a59b96 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:26.382764 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6f0c7ea1-ce5c-4b50-a91e-819573a59b96 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:26.383205 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6f0c7ea1-ce5c-4b50-a91e-819573a59b96 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:26.383936 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6f0c7ea1-ce5c-4b50-a91e-819573a59b96 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:26.384399 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6f0c7ea1-ce5c-4b50-a91e-819573a59b96 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:26.384833 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6f0c7ea1-ce5c-4b50-a91e-819573a59b96 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:26.437830 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-ce2c9b5f-f362-4319-b539-6a472e62259b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:26.439126 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-ce2c9b5f-f362-4319-b539-6a472e62259b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:26.445238 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ce2c9b5f-f362-4319-b539-6a472e62259b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:26.445721 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ce2c9b5f-f362-4319-b539-6a472e62259b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:26.446158 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ce2c9b5f-f362-4319-b539-6a472e62259b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:26.446861 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ce2c9b5f-f362-4319-b539-6a472e62259b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:26.447311 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ce2c9b5f-f362-4319-b539-6a472e62259b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:26.447732 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ce2c9b5f-f362-4319-b539-6a472e62259b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:26.520760 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-6f0c7ea1-ce5c-4b50-a91e-819573a59b96 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:26.528899 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-6f0c7ea1-ce5c-4b50-a91e-819573a59b96 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1734 microversion: 2.1 time: 0.158206 Sep 21 12:27:26.529698 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 350/707] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:27:26 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:27:26.587065 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-ce2c9b5f-f362-4319-b539-6a472e62259b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:26.595783 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-ce2c9b5f-f362-4319-b539-6a472e62259b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:26.597383 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-ce2c9b5f-f362-4319-b539-6a472e62259b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:26.598481 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-ce2c9b5f-f362-4319-b539-6a472e62259b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1405 microversion: 2.20 time: 0.165330 Sep 21 12:27:26.599035 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 358/708] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:27:26 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:27:27.552055 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-bd53a341-f895-4bd9-a6b6-650aafa07a6f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:27.552628 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-bd53a341-f895-4bd9-a6b6-650aafa07a6f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:27.559131 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bd53a341-f895-4bd9-a6b6-650aafa07a6f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:27.559607 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bd53a341-f895-4bd9-a6b6-650aafa07a6f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:27.560079 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bd53a341-f895-4bd9-a6b6-650aafa07a6f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:27.560793 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bd53a341-f895-4bd9-a6b6-650aafa07a6f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:27.561242 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bd53a341-f895-4bd9-a6b6-650aafa07a6f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:27.561715 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bd53a341-f895-4bd9-a6b6-650aafa07a6f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:27.623845 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-42fd4091-0493-4929-bcf1-4ceb8580efca tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:27.624462 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-42fd4091-0493-4929-bcf1-4ceb8580efca tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:27.631453 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-42fd4091-0493-4929-bcf1-4ceb8580efca tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:27.631941 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-42fd4091-0493-4929-bcf1-4ceb8580efca tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:27.632496 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-42fd4091-0493-4929-bcf1-4ceb8580efca tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:27.633215 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-42fd4091-0493-4929-bcf1-4ceb8580efca tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:27.633677 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-42fd4091-0493-4929-bcf1-4ceb8580efca tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:27.634103 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-42fd4091-0493-4929-bcf1-4ceb8580efca tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:27.693411 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-bd53a341-f895-4bd9-a6b6-650aafa07a6f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:27.702248 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-bd53a341-f895-4bd9-a6b6-650aafa07a6f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1714 microversion: 2.1 time: 0.154072 Sep 21 12:27:27.702836 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 351/709] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:27:27 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1714 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:27:27.769275 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-42fd4091-0493-4929-bcf1-4ceb8580efca tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:27.773229 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=100 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:27:27.779369 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-76a072b8-963b-4cdb-ab92-a22614bc50e3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:27.779911 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-76a072b8-963b-4cdb-ab92-a22614bc50e3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:27.783822 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-42fd4091-0493-4929-bcf1-4ceb8580efca tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:27.787558 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-76a072b8-963b-4cdb-ab92-a22614bc50e3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:27.787737 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-42fd4091-0493-4929-bcf1-4ceb8580efca tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:27.788090 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-76a072b8-963b-4cdb-ab92-a22614bc50e3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:27.789129 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-76a072b8-963b-4cdb-ab92-a22614bc50e3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:27.789263 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-42fd4091-0493-4929-bcf1-4ceb8580efca tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1405 microversion: 2.20 time: 0.169054 Sep 21 12:27:27.789458 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-76a072b8-963b-4cdb-ab92-a22614bc50e3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:27.789740 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 359/710] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:27:27 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:27:27.812137 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-76a072b8-963b-4cdb-ab92-a22614bc50e3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:27.813722 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-76a072b8-963b-4cdb-ab92-a22614bc50e3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:27.902169 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.wsgi [None req-76a072b8-963b-4cdb-ab92-a22614bc50e3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] HTTP exception thrown: Cannot 'detach_volume' instance 5f4f10b5-8953-4c76-a286-6974d7c88433 while it is in vm_state rescued Sep 21 12:27:27.903821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-76a072b8-963b-4cdb-ab92-a22614bc50e3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Request method failure captured: Sep 21 12:27:27.903821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: request: DELETE /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433/os-volume_attachments/ecc73aa7-7c05-45d1-9559-ccffa3dfb570 HTTP/1.1 Sep 21 12:27:27.903821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept: application/json Sep 21 12:27:27.903821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept-Encoding: identity Sep 21 12:27:27.903821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Connection: close Sep 21 12:27:27.903821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Length: 0 Sep 21 12:27:27.903821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Type: application/json Sep 21 12:27:27.903821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Host: 10.222.0.71 Sep 21 12:27:27.903821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Openstack-System-Scope: None Sep 21 12:27:27.903821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: User-Agent: python-urllib3/1.26.12 Sep 21 12:27:27.903821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Auth-Token: gAAAAABjKwIu3mnwMp4ApNIfIkJUKxsVNJlj-i9y2ZniVDXL-EUHk78SFz38tXU5y8GhQ-eemD725G2hynLgc-_b-6YI8t1ZBLfru0cqJKYCMo5RetnJGUB4BU8XXayroqGJwhgW8Hog1xUJ-Zgaw42z7TLv76VdJCVDouWswH2FyTkqoFyyieY Sep 21 12:27:27.903821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Id: None Sep 21 12:27:27.903821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Name: None Sep 21 12:27:27.903821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Identity-Status: Confirmed Sep 21 12:27:27.903821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Is-Admin-Project: True Sep 21 12:27:27.903821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Id: default Sep 21 12:27:27.903821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Name: Default Sep 21 12:27:27.903821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Id: d3bd02ae79fd4edb9886b1b4ef3d761a Sep 21 12:27:27.903821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-914007599 Sep 21 12:27:27.903821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Role: reader,member Sep 21 12:27:27.903821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Roles: reader,member Sep 21 12:27:27.905143 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/d3bd02ae79fd4edb9886b1b4ef3d761a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/d3bd02ae79fd4edb9886b1b4ef3d761a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_d3bd02ae79fd4edb9886b1b4ef3d761a", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/d3bd02ae79fd4edb9886b1b4ef3d761a"}]}] Sep 21 12:27:27.905143 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant: tempest-ServerRescueNegativeTestJSON-914007599 Sep 21 12:27:27.905143 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Id: d3bd02ae79fd4edb9886b1b4ef3d761a Sep 21 12:27:27.905143 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-914007599 Sep 21 12:27:27.905143 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User: tempest-ServerRescueNegativeTestJSON-914007599-project Sep 21 12:27:27.905143 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Id: default Sep 21 12:27:27.905143 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Name: Default Sep 21 12:27:27.905143 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Id: 0fb9105e474a4a29904722b1e33d0155 Sep 21 12:27:27.905143 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Name: tempest-ServerRescueNegativeTestJSON-914007599-project Sep 21 12:27:27.905143 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: method: > Sep 21 12:27:27.905143 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: exception: Cannot 'detach_volume' instance 5f4f10b5-8953-4c76-a286-6974d7c88433 while it is in vm_state rescued Sep 21 12:27:27.905886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: action_args: {'server_id': '5f4f10b5-8953-4c76-a286-6974d7c88433', 'id': 'ecc73aa7-7c05-45d1-9559-ccffa3dfb570'} Sep 21 12:27:27.905886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:27:27.905886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:27:27.905886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 21 12:27:27.905886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 21 12:27:27.905886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 21 12:27:27.905886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 21 12:27:27.905886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 21 12:27:27.905886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 21 12:27:27.905886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5f4f10b5-8953-4c76-a286-6974d7c88433 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 21 12:27:27.905886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:27:27.905886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:27:27.905886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:27:27.905886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:27:27.905886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:27:27.905886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:27:27.905886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:27:27.905886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:27:27.905886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:27:27.905886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:27:27.907740 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 21 12:27:27.907740 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 21 12:27:27.907740 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 21 12:27:27.907740 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 21 12:27:27.907740 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 5f4f10b5-8953-4c76-a286-6974d7c88433 while it is in vm_state rescued Sep 21 12:27:27.907740 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:27:27.907740 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:27:27.907740 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:27:27.907740 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:27:27.907740 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:27:27.907740 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:27:27.907740 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:27:27.907740 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:27:27.907740 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 5f4f10b5-8953-4c76-a286-6974d7c88433 while it is in vm_state rescued Sep 21 12:27:27.907740 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:27:27.907740 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-76a072b8-963b-4cdb-ab92-a22614bc50e3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Returning 409 to user: Cannot 'detach_volume' instance 5f4f10b5-8953-4c76-a286-6974d7c88433 while it is in vm_state rescued {{(pid=120463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:27:27.908805 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-76a072b8-963b-4cdb-ab92-a22614bc50e3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "DELETE /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433/os-volume_attachments/ecc73aa7-7c05-45d1-9559-ccffa3dfb570" status: 409 len: 152 microversion: 2.1 time: 0.129971 Sep 21 12:27:27.908805 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 352/711] 10.222.0.71 () {58 vars in 1416 bytes} [Wed Sep 21 12:27:27 2022] DELETE /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433/os-volume_attachments/ecc73aa7-7c05-45d1-9559-ccffa3dfb570 => generated 152 bytes in 132 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 21 12:27:27.914678 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-d222e784-82d1-4c63-aaec-fb3c0b844893 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:27:27.915412 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-d222e784-82d1-4c63-aaec-fb3c0b844893 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:27.921891 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d222e784-82d1-4c63-aaec-fb3c0b844893 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:27.922387 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d222e784-82d1-4c63-aaec-fb3c0b844893 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:27.922831 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d222e784-82d1-4c63-aaec-fb3c0b844893 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:27.923533 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d222e784-82d1-4c63-aaec-fb3c0b844893 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:27.924023 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d222e784-82d1-4c63-aaec-fb3c0b844893 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:27.924457 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d222e784-82d1-4c63-aaec-fb3c0b844893 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:27.992173 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-d222e784-82d1-4c63-aaec-fb3c0b844893 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "POST /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433/action" status: 202 len: 0 microversion: 2.1 time: 0.081085 Sep 21 12:27:27.995805 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 360/712] 10.222.0.71 () {60 vars in 1278 bytes} [Wed Sep 21 12:27:27 2022] POST /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 12:27:28.000885 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-dd6b1ae3-8dd2-479b-97e2-5d58609fff84 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:28.001582 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-dd6b1ae3-8dd2-479b-97e2-5d58609fff84 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:28.007779 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dd6b1ae3-8dd2-479b-97e2-5d58609fff84 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:28.008289 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dd6b1ae3-8dd2-479b-97e2-5d58609fff84 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:28.008782 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dd6b1ae3-8dd2-479b-97e2-5d58609fff84 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:28.009649 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dd6b1ae3-8dd2-479b-97e2-5d58609fff84 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:28.010256 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dd6b1ae3-8dd2-479b-97e2-5d58609fff84 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:28.010996 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dd6b1ae3-8dd2-479b-97e2-5d58609fff84 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:28.145195 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-dd6b1ae3-8dd2-479b-97e2-5d58609fff84 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:28.153487 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-dd6b1ae3-8dd2-479b-97e2-5d58609fff84 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1722 microversion: 2.1 time: 0.156398 Sep 21 12:27:28.154062 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 353/713] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:27:27 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:27:28.824445 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-805a4d20-abc2-44c6-8e56-48e3a76bf105 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:28.825133 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-805a4d20-abc2-44c6-8e56-48e3a76bf105 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:28.831467 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-805a4d20-abc2-44c6-8e56-48e3a76bf105 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:28.831984 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-805a4d20-abc2-44c6-8e56-48e3a76bf105 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:28.832417 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-805a4d20-abc2-44c6-8e56-48e3a76bf105 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:28.833098 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-805a4d20-abc2-44c6-8e56-48e3a76bf105 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:28.833546 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-805a4d20-abc2-44c6-8e56-48e3a76bf105 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:28.833967 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-805a4d20-abc2-44c6-8e56-48e3a76bf105 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:28.961360 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-805a4d20-abc2-44c6-8e56-48e3a76bf105 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:28.969901 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-805a4d20-abc2-44c6-8e56-48e3a76bf105 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:28.971341 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-805a4d20-abc2-44c6-8e56-48e3a76bf105 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:28.972505 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-805a4d20-abc2-44c6-8e56-48e3a76bf105 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1405 microversion: 2.20 time: 0.152857 Sep 21 12:27:28.973065 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 361/714] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:27:28 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:27:29.178232 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-95ec1fbb-2fce-4f21-8676-f225fbae7c4d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:29.178847 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-95ec1fbb-2fce-4f21-8676-f225fbae7c4d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:29.185276 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-95ec1fbb-2fce-4f21-8676-f225fbae7c4d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:29.185765 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-95ec1fbb-2fce-4f21-8676-f225fbae7c4d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:29.186205 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-95ec1fbb-2fce-4f21-8676-f225fbae7c4d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:29.186901 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-95ec1fbb-2fce-4f21-8676-f225fbae7c4d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:29.187360 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-95ec1fbb-2fce-4f21-8676-f225fbae7c4d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:29.187861 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-95ec1fbb-2fce-4f21-8676-f225fbae7c4d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:29.317052 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-95ec1fbb-2fce-4f21-8676-f225fbae7c4d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:29.325241 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-95ec1fbb-2fce-4f21-8676-f225fbae7c4d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1722 microversion: 2.1 time: 0.150888 Sep 21 12:27:29.326073 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 354/715] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:27:29 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:27:29.997613 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-eec8c23c-7563-456e-8961-4a7636a137ba tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:29.998162 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-eec8c23c-7563-456e-8961-4a7636a137ba tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:30.005188 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-eec8c23c-7563-456e-8961-4a7636a137ba tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:30.005671 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-eec8c23c-7563-456e-8961-4a7636a137ba tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:30.006100 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-eec8c23c-7563-456e-8961-4a7636a137ba tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:30.006788 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-eec8c23c-7563-456e-8961-4a7636a137ba tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:30.007241 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-eec8c23c-7563-456e-8961-4a7636a137ba tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:30.007663 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-eec8c23c-7563-456e-8961-4a7636a137ba tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:30.136309 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-eec8c23c-7563-456e-8961-4a7636a137ba tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:30.144454 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-eec8c23c-7563-456e-8961-4a7636a137ba tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:30.145906 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-eec8c23c-7563-456e-8961-4a7636a137ba tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:30.147018 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-eec8c23c-7563-456e-8961-4a7636a137ba tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1405 microversion: 2.20 time: 0.153412 Sep 21 12:27:30.147569 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 362/716] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:27:29 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:27:30.349666 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-687cf80c-2e08-4c47-9e07-aa99b1066cac tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:30.350281 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-687cf80c-2e08-4c47-9e07-aa99b1066cac tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:30.356882 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-687cf80c-2e08-4c47-9e07-aa99b1066cac tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:30.357366 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-687cf80c-2e08-4c47-9e07-aa99b1066cac tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:30.357807 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-687cf80c-2e08-4c47-9e07-aa99b1066cac tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:30.358498 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-687cf80c-2e08-4c47-9e07-aa99b1066cac tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:30.358949 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-687cf80c-2e08-4c47-9e07-aa99b1066cac tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:30.359379 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-687cf80c-2e08-4c47-9e07-aa99b1066cac tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:30.485451 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-687cf80c-2e08-4c47-9e07-aa99b1066cac tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:30.494170 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-687cf80c-2e08-4c47-9e07-aa99b1066cac tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1722 microversion: 2.1 time: 0.148319 Sep 21 12:27:30.494744 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 355/717] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:27:30 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:27:31.172080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-3bec1253-a42e-4c31-b5fe-9489a1dfbea2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:31.172624 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-3bec1253-a42e-4c31-b5fe-9489a1dfbea2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:31.179073 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3bec1253-a42e-4c31-b5fe-9489a1dfbea2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:31.179561 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3bec1253-a42e-4c31-b5fe-9489a1dfbea2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:31.180037 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3bec1253-a42e-4c31-b5fe-9489a1dfbea2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:31.180730 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3bec1253-a42e-4c31-b5fe-9489a1dfbea2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:31.181188 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3bec1253-a42e-4c31-b5fe-9489a1dfbea2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:31.181616 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3bec1253-a42e-4c31-b5fe-9489a1dfbea2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:31.307351 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-3bec1253-a42e-4c31-b5fe-9489a1dfbea2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:31.316792 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-3bec1253-a42e-4c31-b5fe-9489a1dfbea2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:31.318500 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-3bec1253-a42e-4c31-b5fe-9489a1dfbea2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:31.319642 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-3bec1253-a42e-4c31-b5fe-9489a1dfbea2 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1405 microversion: 2.20 time: 0.151655 Sep 21 12:27:31.320344 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 363/718] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:27:31 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:27:31.517051 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-c17bcb44-7e9f-459a-a5d7-d9e0a523666e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:31.517776 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-c17bcb44-7e9f-459a-a5d7-d9e0a523666e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:31.525250 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c17bcb44-7e9f-459a-a5d7-d9e0a523666e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:31.525736 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c17bcb44-7e9f-459a-a5d7-d9e0a523666e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:31.526178 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c17bcb44-7e9f-459a-a5d7-d9e0a523666e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:31.526883 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c17bcb44-7e9f-459a-a5d7-d9e0a523666e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:31.527334 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c17bcb44-7e9f-459a-a5d7-d9e0a523666e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:31.527802 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c17bcb44-7e9f-459a-a5d7-d9e0a523666e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:31.667349 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-c17bcb44-7e9f-459a-a5d7-d9e0a523666e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:31.676601 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-c17bcb44-7e9f-459a-a5d7-d9e0a523666e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1722 microversion: 2.1 time: 0.163356 Sep 21 12:27:31.677167 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 356/719] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:27:31 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:27:32.346220 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-b7fc6bae-3aef-4e19-9160-0faec8c765a0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:32.346788 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-b7fc6bae-3aef-4e19-9160-0faec8c765a0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:32.348707 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell0:SELECT=2 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:27:32.349372 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell0:SELECT=10 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:27:32.356132 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b7fc6bae-3aef-4e19-9160-0faec8c765a0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:32.356682 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b7fc6bae-3aef-4e19-9160-0faec8c765a0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:32.357168 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b7fc6bae-3aef-4e19-9160-0faec8c765a0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:32.357872 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b7fc6bae-3aef-4e19-9160-0faec8c765a0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:32.358329 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b7fc6bae-3aef-4e19-9160-0faec8c765a0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:32.358760 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b7fc6bae-3aef-4e19-9160-0faec8c765a0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:32.487994 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-b7fc6bae-3aef-4e19-9160-0faec8c765a0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:32.495945 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-b7fc6bae-3aef-4e19-9160-0faec8c765a0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:32.497380 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-b7fc6bae-3aef-4e19-9160-0faec8c765a0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:32.498474 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-b7fc6bae-3aef-4e19-9160-0faec8c765a0 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1405 microversion: 2.20 time: 0.156798 Sep 21 12:27:32.499034 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 364/720] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:27:32 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:27:32.700438 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-732d89ce-fe45-4645-8201-f5c66135f393 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:32.701256 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-732d89ce-fe45-4645-8201-f5c66135f393 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:32.703108 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell0:SELECT=2 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:27:32.709430 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-732d89ce-fe45-4645-8201-f5c66135f393 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:32.709920 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-732d89ce-fe45-4645-8201-f5c66135f393 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:32.710362 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-732d89ce-fe45-4645-8201-f5c66135f393 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:32.711054 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-732d89ce-fe45-4645-8201-f5c66135f393 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:32.711512 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-732d89ce-fe45-4645-8201-f5c66135f393 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:32.711980 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-732d89ce-fe45-4645-8201-f5c66135f393 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:32.854593 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-732d89ce-fe45-4645-8201-f5c66135f393 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:32.862749 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-732d89ce-fe45-4645-8201-f5c66135f393 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1722 microversion: 2.1 time: 0.166282 Sep 21 12:27:32.863328 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 357/721] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:27:32 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:27:33.522989 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-5470a303-9f99-4ecc-917d-4a6ba284344d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:33.523609 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-5470a303-9f99-4ecc-917d-4a6ba284344d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:33.530084 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5470a303-9f99-4ecc-917d-4a6ba284344d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:33.530595 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5470a303-9f99-4ecc-917d-4a6ba284344d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:33.531015 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5470a303-9f99-4ecc-917d-4a6ba284344d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:33.532255 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5470a303-9f99-4ecc-917d-4a6ba284344d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:33.532882 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5470a303-9f99-4ecc-917d-4a6ba284344d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:33.533303 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5470a303-9f99-4ecc-917d-4a6ba284344d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:33.681678 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-5470a303-9f99-4ecc-917d-4a6ba284344d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:33.688648 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-d2e481fc-333d-4eaf-b9ff-d015696e23f8 req-2bd74446-7455-4f8e-8c9d-d555116b0e5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc34c677-0e22-4734-95ed-4a6834d9dc7b", "name": "network-vif-plugged", "status": "completed", "tag": "49e15f4c-39c9-4c9a-bb24-e89e5dcc9eab"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:27:33.698746 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-5470a303-9f99-4ecc-917d-4a6ba284344d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:33.700317 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-5470a303-9f99-4ecc-917d-4a6ba284344d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:33.701890 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-5470a303-9f99-4ecc-917d-4a6ba284344d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1405 microversion: 2.20 time: 0.182806 Sep 21 12:27:33.702253 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-d2e481fc-333d-4eaf-b9ff-d015696e23f8 req-2bd74446-7455-4f8e-8c9d-d555116b0e5d service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:33.702726 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 365/722] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:27:33 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1405 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:27:33.703969 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-d2e481fc-333d-4eaf-b9ff-d015696e23f8 req-2bd74446-7455-4f8e-8c9d-d555116b0e5d service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:33.704403 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-d2e481fc-333d-4eaf-b9ff-d015696e23f8 req-2bd74446-7455-4f8e-8c9d-d555116b0e5d service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:33.868520 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-d2e481fc-333d-4eaf-b9ff-d015696e23f8 req-2bd74446-7455-4f8e-8c9d-d555116b0e5d service nova] Creating event network-vif-plugged:49e15f4c-39c9-4c9a-bb24-e89e5dcc9eab for instance dc34c677-0e22-4734-95ed-4a6834d9dc7b on hv-cinder-85867 Sep 21 12:27:33.873711 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-d2e481fc-333d-4eaf-b9ff-d015696e23f8 req-2bd74446-7455-4f8e-8c9d-d555116b0e5d service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.266204 Sep 21 12:27:33.874305 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 358/723] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:27:33.886486 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-f85edfe2-0fde-49f5-a112-5541af41506b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:33.887095 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-f85edfe2-0fde-49f5-a112-5541af41506b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:33.893756 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f85edfe2-0fde-49f5-a112-5541af41506b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:33.894258 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f85edfe2-0fde-49f5-a112-5541af41506b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:33.894692 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f85edfe2-0fde-49f5-a112-5541af41506b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:33.895378 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f85edfe2-0fde-49f5-a112-5541af41506b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:33.895861 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f85edfe2-0fde-49f5-a112-5541af41506b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:33.896283 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f85edfe2-0fde-49f5-a112-5541af41506b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:34.023696 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-f85edfe2-0fde-49f5-a112-5541af41506b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:34.033587 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-f85edfe2-0fde-49f5-a112-5541af41506b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1728 microversion: 2.1 time: 0.150889 Sep 21 12:27:34.034164 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 366/724] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:27:33 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:27:34.056308 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-a07ca3d9-8bc7-4716-b9b0-b8be7785741a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:34.056937 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-a07ca3d9-8bc7-4716-b9b0-b8be7785741a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:34.064073 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a07ca3d9-8bc7-4716-b9b0-b8be7785741a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:34.064576 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a07ca3d9-8bc7-4716-b9b0-b8be7785741a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:34.065025 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a07ca3d9-8bc7-4716-b9b0-b8be7785741a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:34.065748 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a07ca3d9-8bc7-4716-b9b0-b8be7785741a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:34.066207 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a07ca3d9-8bc7-4716-b9b0-b8be7785741a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:34.066640 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a07ca3d9-8bc7-4716-b9b0-b8be7785741a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:34.151479 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-a07ca3d9-8bc7-4716-b9b0-b8be7785741a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099355 Sep 21 12:27:34.152196 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 359/725] 10.222.0.71 () {58 vars in 1275 bytes} [Wed Sep 21 12:27:34 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:27:34.728226 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-2e896419-9134-4b67-b2de-723a2bf54b87 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:34.728973 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-2e896419-9134-4b67-b2de-723a2bf54b87 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:34.735925 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2e896419-9134-4b67-b2de-723a2bf54b87 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:34.736451 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2e896419-9134-4b67-b2de-723a2bf54b87 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:34.736890 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2e896419-9134-4b67-b2de-723a2bf54b87 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:34.737589 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2e896419-9134-4b67-b2de-723a2bf54b87 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:34.738100 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2e896419-9134-4b67-b2de-723a2bf54b87 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:34.738529 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2e896419-9134-4b67-b2de-723a2bf54b87 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:34.870694 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-2e896419-9134-4b67-b2de-723a2bf54b87 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:34.879354 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-2e896419-9134-4b67-b2de-723a2bf54b87 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:34.880873 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-2e896419-9134-4b67-b2de-723a2bf54b87 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:34.881967 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-2e896419-9134-4b67-b2de-723a2bf54b87 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1405 microversion: 2.20 time: 0.157841 Sep 21 12:27:34.882528 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 367/726] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:27:34 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:27:35.296024 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-6a836303-4561-435d-8c91-a65dd3c8dcde req-2ac7f68e-94e4-4c77-957f-0695267680e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f4f10b5-8953-4c76-a286-6974d7c88433", "tag": "0b66debc-125c-4397-a41e-08b95892a114"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:27:35.305676 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-6a836303-4561-435d-8c91-a65dd3c8dcde req-2ac7f68e-94e4-4c77-957f-0695267680e1 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:35.306160 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-6a836303-4561-435d-8c91-a65dd3c8dcde req-2ac7f68e-94e4-4c77-957f-0695267680e1 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:35.306591 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-6a836303-4561-435d-8c91-a65dd3c8dcde req-2ac7f68e-94e4-4c77-957f-0695267680e1 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:35.317495 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-6a836303-4561-435d-8c91-a65dd3c8dcde req-2ac7f68e-94e4-4c77-957f-0695267680e1 service nova] Creating event network-changed:0b66debc-125c-4397-a41e-08b95892a114 for instance 5f4f10b5-8953-4c76-a286-6974d7c88433 on hv-cinder-85867 Sep 21 12:27:35.322369 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-6a836303-4561-435d-8c91-a65dd3c8dcde req-2ac7f68e-94e4-4c77-957f-0695267680e1 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089736 Sep 21 12:27:35.322897 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 360/727] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:27:35.909155 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-bed73360-0803-4b55-a605-8f067da0d836 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:35.910255 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-bed73360-0803-4b55-a605-8f067da0d836 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:35.921736 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bed73360-0803-4b55-a605-8f067da0d836 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:35.922235 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bed73360-0803-4b55-a605-8f067da0d836 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:35.922687 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bed73360-0803-4b55-a605-8f067da0d836 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:35.926058 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bed73360-0803-4b55-a605-8f067da0d836 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:35.926244 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bed73360-0803-4b55-a605-8f067da0d836 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:35.926603 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bed73360-0803-4b55-a605-8f067da0d836 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:36.067039 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-bed73360-0803-4b55-a605-8f067da0d836 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:36.075245 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-bed73360-0803-4b55-a605-8f067da0d836 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:36.076985 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-bed73360-0803-4b55-a605-8f067da0d836 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:27:36.078203 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-bed73360-0803-4b55-a605-8f067da0d836 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1597 microversion: 2.20 time: 0.173169 Sep 21 12:27:36.078772 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 368/728] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:27:35 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1597 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:27:36.102980 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-aacbea4e-b307-4b94-ab22-f02400281c2c tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:27:36.103620 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-aacbea4e-b307-4b94-ab22-f02400281c2c tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:27:36.110458 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-aacbea4e-b307-4b94-ab22-f02400281c2c tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:36.111241 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-aacbea4e-b307-4b94-ab22-f02400281c2c tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:36.111688 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-aacbea4e-b307-4b94-ab22-f02400281c2c tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:36.112460 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-aacbea4e-b307-4b94-ab22-f02400281c2c tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:36.112924 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-aacbea4e-b307-4b94-ab22-f02400281c2c tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:36.113351 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-aacbea4e-b307-4b94-ab22-f02400281c2c tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:36.192088 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-aacbea4e-b307-4b94-ab22-f02400281c2c tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093365 Sep 21 12:27:36.192687 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 361/729] 10.222.0.71 () {60 vars in 1316 bytes} [Wed Sep 21 12:27:36 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 21 12:27:37.337927 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-abf82ee2-81a0-4197-9af0-d90ed576f231 req-3f4a5cb9-1e88-49d8-966d-312cd05af011 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f4f10b5-8953-4c76-a286-6974d7c88433", "tag": "0b66debc-125c-4397-a41e-08b95892a114"}, {"name": "network-changed", "server_uuid": "dc34c677-0e22-4734-95ed-4a6834d9dc7b", "tag": "49e15f4c-39c9-4c9a-bb24-e89e5dcc9eab"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:27:37.348594 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-abf82ee2-81a0-4197-9af0-d90ed576f231 req-3f4a5cb9-1e88-49d8-966d-312cd05af011 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:27:37.349081 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-abf82ee2-81a0-4197-9af0-d90ed576f231 req-3f4a5cb9-1e88-49d8-966d-312cd05af011 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:27:37.349519 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-abf82ee2-81a0-4197-9af0-d90ed576f231 req-3f4a5cb9-1e88-49d8-966d-312cd05af011 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:27:37.361997 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-abf82ee2-81a0-4197-9af0-d90ed576f231 req-3f4a5cb9-1e88-49d8-966d-312cd05af011 service nova] Creating event network-changed:0b66debc-125c-4397-a41e-08b95892a114 for instance 5f4f10b5-8953-4c76-a286-6974d7c88433 on hv-cinder-85867 Sep 21 12:27:37.362503 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-abf82ee2-81a0-4197-9af0-d90ed576f231 req-3f4a5cb9-1e88-49d8-966d-312cd05af011 service nova] Creating event network-changed:49e15f4c-39c9-4c9a-bb24-e89e5dcc9eab for instance dc34c677-0e22-4734-95ed-4a6834d9dc7b on hv-cinder-85867 Sep 21 12:27:37.369116 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-abf82ee2-81a0-4197-9af0-d90ed576f231 req-3f4a5cb9-1e88-49d8-966d-312cd05af011 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.034895 Sep 21 12:27:37.369899 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 369/730] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:28:01.825240 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=45 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:01.825994 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=86 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:01.830588 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-718db766-5faa-4ca4-9fd9-dd8b665d1a8b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:01.832745 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-718db766-5faa-4ca4-9fd9-dd8b665d1a8b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:01.839428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-718db766-5faa-4ca4-9fd9-dd8b665d1a8b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:01.839966 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-718db766-5faa-4ca4-9fd9-dd8b665d1a8b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:01.840412 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-718db766-5faa-4ca4-9fd9-dd8b665d1a8b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:01.841108 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-718db766-5faa-4ca4-9fd9-dd8b665d1a8b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:01.841575 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-718db766-5faa-4ca4-9fd9-dd8b665d1a8b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:01.842009 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-718db766-5faa-4ca4-9fd9-dd8b665d1a8b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:01.870964 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-718db766-5faa-4ca4-9fd9-dd8b665d1a8b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047562 Sep 21 12:28:01.871539 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 362/731] 10.222.0.71 () {58 vars in 1302 bytes} [Wed Sep 21 12:28:01 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 21 12:28:01.932590 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:01.933348 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:01.938150 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-e6f5a6c3-2207-457a-851e-f7918c6ab470 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:01.938765 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-e6f5a6c3-2207-457a-851e-f7918c6ab470 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:01.946757 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e6f5a6c3-2207-457a-851e-f7918c6ab470 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:01.947246 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e6f5a6c3-2207-457a-851e-f7918c6ab470 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:01.947682 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e6f5a6c3-2207-457a-851e-f7918c6ab470 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:01.948468 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e6f5a6c3-2207-457a-851e-f7918c6ab470 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:01.948924 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e6f5a6c3-2207-457a-851e-f7918c6ab470 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:01.949349 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e6f5a6c3-2207-457a-851e-f7918c6ab470 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:01.977476 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-e6f5a6c3-2207-457a-851e-f7918c6ab470 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Going to try to terminate instance {{(pid=120462) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 12:28:02.052563 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-e6f5a6c3-2207-457a-851e-f7918c6ab470 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "DELETE /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 204 len: 0 microversion: 2.1 time: 0.121408 Sep 21 12:28:02.053424 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 370/732] 10.222.0.71 () {58 vars in 1239 bytes} [Wed Sep 21 12:28:01 2022] DELETE /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 21 12:28:02.062500 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-8b05555f-e116-4d05-a5ef-c5b8d1a7a31e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:02.063116 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-8b05555f-e116-4d05-a5ef-c5b8d1a7a31e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:02.069111 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8b05555f-e116-4d05-a5ef-c5b8d1a7a31e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:02.069594 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8b05555f-e116-4d05-a5ef-c5b8d1a7a31e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:02.070029 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8b05555f-e116-4d05-a5ef-c5b8d1a7a31e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:02.070726 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8b05555f-e116-4d05-a5ef-c5b8d1a7a31e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:02.071182 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8b05555f-e116-4d05-a5ef-c5b8d1a7a31e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:02.071599 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8b05555f-e116-4d05-a5ef-c5b8d1a7a31e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:02.198313 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-8b05555f-e116-4d05-a5ef-c5b8d1a7a31e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:28:02.207075 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-8b05555f-e116-4d05-a5ef-c5b8d1a7a31e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1672 microversion: 2.1 time: 0.149083 Sep 21 12:28:02.207641 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 363/733] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:02 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:28:03.230800 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-23ebb97d-bb0d-4c63-ac48-7e6cbd6893b4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:03.231530 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-23ebb97d-bb0d-4c63-ac48-7e6cbd6893b4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:03.240759 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-23ebb97d-bb0d-4c63-ac48-7e6cbd6893b4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:03.241250 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-23ebb97d-bb0d-4c63-ac48-7e6cbd6893b4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:03.241685 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-23ebb97d-bb0d-4c63-ac48-7e6cbd6893b4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:03.242378 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-23ebb97d-bb0d-4c63-ac48-7e6cbd6893b4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:03.242826 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-23ebb97d-bb0d-4c63-ac48-7e6cbd6893b4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:03.243252 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-23ebb97d-bb0d-4c63-ac48-7e6cbd6893b4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:03.378510 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-23ebb97d-bb0d-4c63-ac48-7e6cbd6893b4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:28:03.387506 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-23ebb97d-bb0d-4c63-ac48-7e6cbd6893b4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1672 microversion: 2.1 time: 0.160890 Sep 21 12:28:03.388138 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 371/734] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:03 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:28:04.412032 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-9c20e642-f2f8-4975-a19c-1dab7691744d tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:04.412649 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-9c20e642-f2f8-4975-a19c-1dab7691744d tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:04.419193 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9c20e642-f2f8-4975-a19c-1dab7691744d tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:04.419676 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9c20e642-f2f8-4975-a19c-1dab7691744d tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:04.420785 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9c20e642-f2f8-4975-a19c-1dab7691744d tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:04.421515 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9c20e642-f2f8-4975-a19c-1dab7691744d tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:04.422076 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9c20e642-f2f8-4975-a19c-1dab7691744d tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:04.422362 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9c20e642-f2f8-4975-a19c-1dab7691744d tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:04.490328 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-9c20e642-f2f8-4975-a19c-1dab7691744d tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:28:04.490911 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-8060a2a1-6b03-4122-8efb-d6b4d9203a11 req-9007844e-5c36-4f06-9e57-c98f4d0e98ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee010d1f-46d4-487e-a93e-66c5e2ac895e", "name": "network-vif-deleted", "tag": "ee7ca2d0-d70f-46f5-af82-81e48a262d02"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:28:04.499609 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-9c20e642-f2f8-4975-a19c-1dab7691744d tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 200 len: 1604 microversion: 2.1 time: 0.091427 Sep 21 12:28:04.500644 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 364/735] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:04 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 1604 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:28:04.505875 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-8060a2a1-6b03-4122-8efb-d6b4d9203a11 req-9007844e-5c36-4f06-9e57-c98f4d0e98ec service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:04.506354 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-8060a2a1-6b03-4122-8efb-d6b4d9203a11 req-9007844e-5c36-4f06-9e57-c98f4d0e98ec service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:04.506873 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-8060a2a1-6b03-4122-8efb-d6b4d9203a11 req-9007844e-5c36-4f06-9e57-c98f4d0e98ec service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:04.519392 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-8060a2a1-6b03-4122-8efb-d6b4d9203a11 req-9007844e-5c36-4f06-9e57-c98f4d0e98ec service nova] Creating event network-vif-deleted:ee7ca2d0-d70f-46f5-af82-81e48a262d02 for instance ee010d1f-46d4-487e-a93e-66c5e2ac895e on hv-cinder-85867 Sep 21 12:28:04.524885 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-8060a2a1-6b03-4122-8efb-d6b4d9203a11 req-9007844e-5c36-4f06-9e57-c98f4d0e98ec service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038878 Sep 21 12:28:04.525704 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 372/736] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 12:28:05.523333 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-635bb631-86e3-4cc1-99ed-ca02908051b7 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:05.524250 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-635bb631-86e3-4cc1-99ed-ca02908051b7 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:05.531512 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-635bb631-86e3-4cc1-99ed-ca02908051b7 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:05.532193 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-635bb631-86e3-4cc1-99ed-ca02908051b7 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:05.532647 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-635bb631-86e3-4cc1-99ed-ca02908051b7 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:05.533429 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-635bb631-86e3-4cc1-99ed-ca02908051b7 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:05.533961 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-635bb631-86e3-4cc1-99ed-ca02908051b7 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:05.534491 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-635bb631-86e3-4cc1-99ed-ca02908051b7 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:05.549357 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.wsgi [None req-635bb631-86e3-4cc1-99ed-ca02908051b7 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] HTTP exception thrown: Instance ee010d1f-46d4-487e-a93e-66c5e2ac895e could not be found. Sep 21 12:28:05.551113 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-635bb631-86e3-4cc1-99ed-ca02908051b7 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Request method failure captured: Sep 21 12:28:05.551113 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: request: GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e HTTP/1.1 Sep 21 12:28:05.551113 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept: application/json Sep 21 12:28:05.551113 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept-Encoding: identity Sep 21 12:28:05.551113 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Connection: close Sep 21 12:28:05.551113 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Length: 0 Sep 21 12:28:05.551113 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Type: application/json Sep 21 12:28:05.551113 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Host: 10.222.0.71 Sep 21 12:28:05.551113 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Openstack-System-Scope: None Sep 21 12:28:05.551113 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: User-Agent: python-urllib3/1.26.12 Sep 21 12:28:05.551113 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Auth-Token: gAAAAABjKwGp0KjgM_ndjptxwLGhVApHaQzyngoX69SpmnL3OTWtuoH75cPAz9ySdKN9ANQ84Gpscfvltf8W5ER92YP4kr_u_TD1VCoJF2B1xO3RAGirJWPKEvwdA77dha7dIk8YIqrPVzLb-I5bTZ5zfnCJbSYJGEE0BnyXPMZsLyIt9WY4RPs Sep 21 12:28:05.551113 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Id: None Sep 21 12:28:05.551113 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Name: None Sep 21 12:28:05.551113 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Identity-Status: Confirmed Sep 21 12:28:05.551113 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Is-Admin-Project: True Sep 21 12:28:05.551113 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Id: default Sep 21 12:28:05.551113 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Name: Default Sep 21 12:28:05.551113 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Id: 9340222cfe154efe8a6064b197d54499 Sep 21 12:28:05.551113 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Name: tempest-AttachVolumeTestJSON-1528768827 Sep 21 12:28:05.551113 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Role: reader,member Sep 21 12:28:05.551113 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Roles: reader,member Sep 21 12:28:05.552854 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9340222cfe154efe8a6064b197d54499"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9340222cfe154efe8a6064b197d54499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_9340222cfe154efe8a6064b197d54499", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/9340222cfe154efe8a6064b197d54499"}]}] Sep 21 12:28:05.552854 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant: tempest-AttachVolumeTestJSON-1528768827 Sep 21 12:28:05.552854 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Id: 9340222cfe154efe8a6064b197d54499 Sep 21 12:28:05.552854 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1528768827 Sep 21 12:28:05.552854 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User: tempest-AttachVolumeTestJSON-1528768827-project Sep 21 12:28:05.552854 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Id: default Sep 21 12:28:05.552854 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Name: Default Sep 21 12:28:05.552854 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Id: 8790c086dcaa4da5b739bcd02d30b4c0 Sep 21 12:28:05.552854 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Name: tempest-AttachVolumeTestJSON-1528768827-project Sep 21 12:28:05.552854 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: method: > Sep 21 12:28:05.552854 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: exception: Instance ee010d1f-46d4-487e-a93e-66c5e2ac895e could not be found. Sep 21 12:28:05.552854 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: action_args: {'id': 'ee010d1f-46d4-487e-a93e-66c5e2ac895e'} Sep 21 12:28:05.557148 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:28:05.557148 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:28:05.557148 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:28:05.557148 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:28:05.557148 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:28:05.557148 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:28:05.557148 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:28:05.557148 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:28:05.557148 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:28:05.557148 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:28:05.557148 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee010d1f-46d4-487e-a93e-66c5e2ac895e could not be found. Sep 21 12:28:05.557148 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:28:05.557148 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:28:05.557148 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:28:05.557148 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:28:05.557148 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:28:05.557148 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:28:05.557148 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:28:05.557148 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:28:05.557148 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:28:05.558858 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:28:05.558858 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 12:28:05.558858 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 12:28:05.558858 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:28:05.558858 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:28:05.558858 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:28:05.558858 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:28:05.558858 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee010d1f-46d4-487e-a93e-66c5e2ac895e could not be found. Sep 21 12:28:05.558858 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:28:05.558858 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:28:05.558858 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:28:05.558858 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:28:05.558858 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:28:05.558858 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:28:05.558858 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:28:05.558858 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:28:05.558858 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee010d1f-46d4-487e-a93e-66c5e2ac895e could not be found. Sep 21 12:28:05.558858 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:28:05.561323 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-635bb631-86e3-4cc1-99ed-ca02908051b7 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Returning 404 to user: Instance ee010d1f-46d4-487e-a93e-66c5e2ac895e could not be found. {{(pid=120463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:28:05.561323 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-635bb631-86e3-4cc1-99ed-ca02908051b7 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 404 len: 111 microversion: 2.1 time: 0.033914 Sep 21 12:28:05.561323 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 365/737] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:05 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:28:05.564140 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-01b81040-6ed0-4e87-826b-cd99c4d8e211 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '.version_select at 0x7fe4cc6e98b0>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:05.582868 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-01b81040-6ed0-4e87-826b-cd99c4d8e211 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-894034263" status: 202 len: 0 microversion: 2.1 time: 0.023956 Sep 21 12:28:05.583428 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 373/738] 10.222.0.71 () {58 vars in 1218 bytes} [Wed Sep 21 12:28:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-894034263 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 12:28:06.218392 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-03ce7021-2780-4cd4-82d8-24ed66b621c7 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Action: 'create', calling method: .version_select at 0x7fe4c90ea8b0>, body: {"keypair": {"name": "tempest-keypair-1693007900", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNk/evyd/2wb1PDpt7iEtzKesb4VBsJc3fFfyQLvJPB6tpW2mMdd06eqPqUIxPOQvCwpELQbOaLWhYUuPxW+1zcL9nCx6rOVHzC96APsEBAbQOuFYiLb2TXAwIk28GqkDw=="}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:28:06.233372 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.quota [None req-03ce7021-2780-4cd4-82d8-24ed66b621c7 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Getting quotas for project 9340222cfe154efe8a6064b197d54499. Resources: {'key_pairs'} {{(pid=120463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 12:28:06.237198 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.quota [None req-03ce7021-2780-4cd4-82d8-24ed66b621c7 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Getting quotas for user 8790c086dcaa4da5b739bcd02d30b4c0 and project 9340222cfe154efe8a6064b197d54499. Resources: {'key_pairs'} {{(pid=120463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 12:28:06.248656 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR oslo.messaging._drivers.impl_rabbit [None req-03ce7021-2780-4cd4-82d8-24ed66b621c7 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [1a76e2fb-87fc-41a9-be6c-dcfbe62f06e9] AMQP server on 10.222.0.71:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 21 12:28:06.684948 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-e6b2dfd1-7fe4-4402-bdae-3b8efd983575 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-427883083"}} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:28:06.686558 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-e6b2dfd1-7fe4-4402-bdae-3b8efd983575 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:06.693392 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e6b2dfd1-7fe4-4402-bdae-3b8efd983575 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:06.693917 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e6b2dfd1-7fe4-4402-bdae-3b8efd983575 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:06.694366 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e6b2dfd1-7fe4-4402-bdae-3b8efd983575 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:06.695075 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e6b2dfd1-7fe4-4402-bdae-3b8efd983575 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:06.695538 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e6b2dfd1-7fe4-4402-bdae-3b8efd983575 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:06.695992 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e6b2dfd1-7fe4-4402-bdae-3b8efd983575 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:06.836769 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.network.security_group_api [None req-e6b2dfd1-7fe4-4402-bdae-3b8efd983575 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Removing security group 9eb76a99-7f85-4224-b0ee-48e3952ae20b from port 2d86ac1e-8e22-4863-a099-2f5b0b120e07 Sep 21 12:28:07.140782 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-e6b2dfd1-7fe4-4402-bdae-3b8efd983575 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "POST /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9/action" status: 202 len: 0 microversion: 2.1 time: 0.460208 Sep 21 12:28:07.141397 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 374/739] 10.222.0.71 () {60 vars in 1278 bytes} [Wed Sep 21 12:28:06 2022] POST /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 21 12:28:07.152142 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-025ab0ad-0942-4fdf-9403-bd71f0bda7e2 req-048b6cca-b466-425d-9061-4832e1ee986c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cc8e107-efaf-4689-9e8f-f8adc955c6d9", "tag": "2d86ac1e-8e22-4863-a099-2f5b0b120e07"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:28:07.163975 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-025ab0ad-0942-4fdf-9403-bd71f0bda7e2 req-048b6cca-b466-425d-9061-4832e1ee986c service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:07.164449 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-025ab0ad-0942-4fdf-9403-bd71f0bda7e2 req-048b6cca-b466-425d-9061-4832e1ee986c service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:07.164888 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-025ab0ad-0942-4fdf-9403-bd71f0bda7e2 req-048b6cca-b466-425d-9061-4832e1ee986c service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:07.177380 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-025ab0ad-0942-4fdf-9403-bd71f0bda7e2 req-048b6cca-b466-425d-9061-4832e1ee986c service nova] Creating event network-changed:2d86ac1e-8e22-4863-a099-2f5b0b120e07 for instance 3cc8e107-efaf-4689-9e8f-f8adc955c6d9 on hv-cinder-85867 Sep 21 12:28:07.182351 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-025ab0ad-0942-4fdf-9403-bd71f0bda7e2 req-048b6cca-b466-425d-9061-4832e1ee986c service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034937 Sep 21 12:28:07.182945 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 375/740] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:28:07.263252 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO oslo.messaging._drivers.impl_rabbit [None req-03ce7021-2780-4cd4-82d8-24ed66b621c7 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [1a76e2fb-87fc-41a9-be6c-dcfbe62f06e9] Reconnected to AMQP server on 10.222.0.71:5672 via [amqp] client with port 42136. Sep 21 12:28:07.294179 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-03ce7021-2780-4cd4-82d8-24ed66b621c7 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.080267 Sep 21 12:28:07.300370 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 366/741] 10.222.0.71 () {60 vars in 1159 bytes} [Wed Sep 21 12:28:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:28:08.556732 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-15869b0e-4c21-4d4f-9bbe-445a1531f739 req-63b416c4-99a5-4c10-8a46-fded9c169d17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cc8e107-efaf-4689-9e8f-f8adc955c6d9", "tag": "2d86ac1e-8e22-4863-a099-2f5b0b120e07"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:28:08.558696 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-c9992da5-d42c-45fa-b29b-4fc080c23223 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:08.559912 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-c9992da5-d42c-45fa-b29b-4fc080c23223 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:08.570328 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c9992da5-d42c-45fa-b29b-4fc080c23223 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:08.571426 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c9992da5-d42c-45fa-b29b-4fc080c23223 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:08.572301 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c9992da5-d42c-45fa-b29b-4fc080c23223 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:08.573000 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c9992da5-d42c-45fa-b29b-4fc080c23223 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:08.573559 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c9992da5-d42c-45fa-b29b-4fc080c23223 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:08.574222 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c9992da5-d42c-45fa-b29b-4fc080c23223 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:08.583827 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-15869b0e-4c21-4d4f-9bbe-445a1531f739 req-63b416c4-99a5-4c10-8a46-fded9c169d17 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:08.584438 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-15869b0e-4c21-4d4f-9bbe-445a1531f739 req-63b416c4-99a5-4c10-8a46-fded9c169d17 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:08.584885 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-15869b0e-4c21-4d4f-9bbe-445a1531f739 req-63b416c4-99a5-4c10-8a46-fded9c169d17 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:08.602245 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-15869b0e-4c21-4d4f-9bbe-445a1531f739 req-63b416c4-99a5-4c10-8a46-fded9c169d17 service nova] Creating event network-changed:2d86ac1e-8e22-4863-a099-2f5b0b120e07 for instance 3cc8e107-efaf-4689-9e8f-f8adc955c6d9 on hv-cinder-85867 Sep 21 12:28:08.610903 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-15869b0e-4c21-4d4f-9bbe-445a1531f739 req-63b416c4-99a5-4c10-8a46-fded9c169d17 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055703 Sep 21 12:28:08.612031 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 367/742] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 12:28:08.678450 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.objects.instance [None req-c9992da5-d42c-45fa-b29b-4fc080c23223 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lazy-loading 'services' on Instance uuid 3cc8e107-efaf-4689-9e8f-f8adc955c6d9 {{(pid=120462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 12:28:08.761654 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-c9992da5-d42c-45fa-b29b-4fc080c23223 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "DELETE /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9/os-volume_attachments/3aa1f7c3-fbbf-444f-a798-a4fa323b706b" status: 202 len: 0 microversion: 2.1 time: 0.209180 Sep 21 12:28:08.762704 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 376/743] 10.222.0.71 () {58 vars in 1416 bytes} [Wed Sep 21 12:28:08 2022] DELETE /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9/os-volume_attachments/3aa1f7c3-fbbf-444f-a798-a4fa323b706b => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 12:28:08.774837 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-6ac5d399-9015-485b-9a9a-4c5ad644e779 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:08.777103 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-6ac5d399-9015-485b-9a9a-4c5ad644e779 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:08.785372 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6ac5d399-9015-485b-9a9a-4c5ad644e779 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:08.786092 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6ac5d399-9015-485b-9a9a-4c5ad644e779 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:08.786704 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6ac5d399-9015-485b-9a9a-4c5ad644e779 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:08.787580 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6ac5d399-9015-485b-9a9a-4c5ad644e779 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:08.788251 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6ac5d399-9015-485b-9a9a-4c5ad644e779 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:08.788863 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6ac5d399-9015-485b-9a9a-4c5ad644e779 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:08.821137 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-6ac5d399-9015-485b-9a9a-4c5ad644e779 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050621 Sep 21 12:28:08.822031 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 368/744] 10.222.0.71 () {58 vars in 1302 bytes} [Wed Sep 21 12:28:08 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:28:09.092788 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-8825c717-6119-42b3-821a-b453b501d302 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1378605766", "imageRef": "1e3a8d95-6338-499c-af91-e3d1345af950", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5da5489c-9c30-4169-9afe-1354fb43296f"}], "security_groups": [{"name": "tempest-securitygroup--1040714024"}], "key_name": "tempest-keypair-1693007900", "user_data": "}} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:28:09.211035 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.network.neutron [None req-8825c717-6119-42b3-821a-b453b501d302 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] validate_networks() for [('5da5489c-9c30-4169-9afe-1354fb43296f', None, None, None, None, None)] {{(pid=120462) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 12:28:09.834210 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-4046018e-252a-45da-b02d-5f3d74a4715b tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:09.837361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-4046018e-252a-45da-b02d-5f3d74a4715b tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:09.844308 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4046018e-252a-45da-b02d-5f3d74a4715b tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:09.844818 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4046018e-252a-45da-b02d-5f3d74a4715b tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:09.845515 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4046018e-252a-45da-b02d-5f3d74a4715b tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:09.846244 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4046018e-252a-45da-b02d-5f3d74a4715b tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:09.846707 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4046018e-252a-45da-b02d-5f3d74a4715b tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:09.847145 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4046018e-252a-45da-b02d-5f3d74a4715b tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:09.892367 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-4046018e-252a-45da-b02d-5f3d74a4715b tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062119 Sep 21 12:28:09.892963 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 369/745] 10.222.0.71 () {58 vars in 1302 bytes} [Wed Sep 21 12:28:09 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 21 12:28:09.903823 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-44ffeba8-1984-477d-a3c2-0fbd1da12132 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:09.904433 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-44ffeba8-1984-477d-a3c2-0fbd1da12132 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:09.912100 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-44ffeba8-1984-477d-a3c2-0fbd1da12132 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:09.912831 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-44ffeba8-1984-477d-a3c2-0fbd1da12132 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:09.913460 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-44ffeba8-1984-477d-a3c2-0fbd1da12132 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:09.914401 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-44ffeba8-1984-477d-a3c2-0fbd1da12132 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:09.915162 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-44ffeba8-1984-477d-a3c2-0fbd1da12132 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:09.915777 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-44ffeba8-1984-477d-a3c2-0fbd1da12132 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:10.000302 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.wsgi [None req-44ffeba8-1984-477d-a3c2-0fbd1da12132 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] HTTP exception thrown: Instance 3cc8e107-efaf-4689-9e8f-f8adc955c6d9 is not attached to volume 3aa1f7c3-fbbf-444f-a798-a4fa323b706b Sep 21 12:28:10.003001 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-44ffeba8-1984-477d-a3c2-0fbd1da12132 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Request method failure captured: Sep 21 12:28:10.003001 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: request: DELETE /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9/os-volume_attachments/3aa1f7c3-fbbf-444f-a798-a4fa323b706b HTTP/1.1 Sep 21 12:28:10.003001 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept: application/json Sep 21 12:28:10.003001 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept-Encoding: identity Sep 21 12:28:10.003001 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Connection: close Sep 21 12:28:10.003001 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Length: 0 Sep 21 12:28:10.003001 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Type: application/json Sep 21 12:28:10.003001 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Host: 10.222.0.71 Sep 21 12:28:10.003001 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Openstack-System-Scope: None Sep 21 12:28:10.003001 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: User-Agent: python-urllib3/1.26.12 Sep 21 12:28:10.003001 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Auth-Token: gAAAAABjKwJswsf8OtZIVzROIfqcrN35SBfoUyB58J_TeXCpgyvo4zdjR5rB2aYl5p78xGnI1aAsyEMrWMLMuSMmccYKmOWfwJ5JE3M-ED3V_N9_HpvlIXhBykqSYn388HJT_XeaHyWe7vUgYSe_CoulysUFn7nLsF0MHNd3gJagScwtkVCUmYs Sep 21 12:28:10.003001 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Id: None Sep 21 12:28:10.003001 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Name: None Sep 21 12:28:10.003001 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Identity-Status: Confirmed Sep 21 12:28:10.003001 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Is-Admin-Project: True Sep 21 12:28:10.003001 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Id: default Sep 21 12:28:10.003001 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Name: Default Sep 21 12:28:10.003001 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Id: 9de710fda38c429a91595545e9a74dcb Sep 21 12:28:10.003001 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Name: tempest-TestMinimumBasicScenario-394132406 Sep 21 12:28:10.003001 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Role: reader,member Sep 21 12:28:10.003001 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Roles: reader,member Sep 21 12:28:10.004598 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9de710fda38c429a91595545e9a74dcb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9de710fda38c429a91595545e9a74dcb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_9de710fda38c429a91595545e9a74dcb", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/9de710fda38c429a91595545e9a74dcb"}]}] Sep 21 12:28:10.004598 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant: tempest-TestMinimumBasicScenario-394132406 Sep 21 12:28:10.004598 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Id: 9de710fda38c429a91595545e9a74dcb Sep 21 12:28:10.004598 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Name: tempest-TestMinimumBasicScenario-394132406 Sep 21 12:28:10.004598 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User: tempest-TestMinimumBasicScenario-394132406-project Sep 21 12:28:10.004598 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Id: default Sep 21 12:28:10.004598 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Name: Default Sep 21 12:28:10.004598 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Id: 8e0b6c8f5ec24d478f47a3d8d2fd941e Sep 21 12:28:10.004598 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Name: tempest-TestMinimumBasicScenario-394132406-project Sep 21 12:28:10.004598 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: method: > Sep 21 12:28:10.004598 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: exception: Instance 3cc8e107-efaf-4689-9e8f-f8adc955c6d9 is not attached to volume 3aa1f7c3-fbbf-444f-a798-a4fa323b706b Sep 21 12:28:10.005458 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: action_args: {'server_id': '3cc8e107-efaf-4689-9e8f-f8adc955c6d9', 'id': '3aa1f7c3-fbbf-444f-a798-a4fa323b706b'} Sep 21 12:28:10.005458 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:28:10.005458 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:28:10.005458 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 21 12:28:10.005458 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 21 12:28:10.005458 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 21 12:28:10.005458 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 21 12:28:10.005458 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 21 12:28:10.005458 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 21 12:28:10.005458 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3aa1f7c3-fbbf-444f-a798-a4fa323b706b. Sep 21 12:28:10.005458 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:28:10.005458 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:28:10.005458 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:28:10.005458 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:28:10.005458 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:28:10.005458 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:28:10.005458 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:28:10.005458 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:28:10.005458 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:28:10.006902 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:28:10.006902 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 21 12:28:10.006902 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 21 12:28:10.006902 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cc8e107-efaf-4689-9e8f-f8adc955c6d9 is not attached to volume 3aa1f7c3-fbbf-444f-a798-a4fa323b706b Sep 21 12:28:10.006902 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:28:10.006902 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:28:10.006902 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:28:10.006902 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:28:10.006902 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:28:10.006902 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:28:10.006902 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:28:10.006902 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:28:10.006902 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cc8e107-efaf-4689-9e8f-f8adc955c6d9 is not attached to volume 3aa1f7c3-fbbf-444f-a798-a4fa323b706b Sep 21 12:28:10.006902 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:28:10.006902 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-44ffeba8-1984-477d-a3c2-0fbd1da12132 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Returning 404 to user: Instance 3cc8e107-efaf-4689-9e8f-f8adc955c6d9 is not attached to volume 3aa1f7c3-fbbf-444f-a798-a4fa323b706b {{(pid=120463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:28:10.008019 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-44ffeba8-1984-477d-a3c2-0fbd1da12132 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "DELETE /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9/os-volume_attachments/3aa1f7c3-fbbf-444f-a798-a4fa323b706b" status: 404 len: 154 microversion: 2.1 time: 0.104766 Sep 21 12:28:10.008428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 370/746] 10.222.0.71 () {58 vars in 1416 bytes} [Wed Sep 21 12:28:09 2022] DELETE /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9/os-volume_attachments/3aa1f7c3-fbbf-444f-a798-a4fa323b706b => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:28:10.110232 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-8825c717-6119-42b3-821a-b453b501d302 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Flavor limits 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 12:28:10.111615 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-8825c717-6119-42b3-821a-b453b501d302 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Image limits 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 12:28:10.112299 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-8825c717-6119-42b3-821a-b453b501d302 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Flavor pref 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 12:28:10.113032 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-8825c717-6119-42b3-821a-b453b501d302 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Image pref 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 12:28:10.113597 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-8825c717-6119-42b3-821a-b453b501d302 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 12:28:10.125018 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8825c717-6119-42b3-821a-b453b501d302 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:10.125694 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8825c717-6119-42b3-821a-b453b501d302 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:10.126213 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8825c717-6119-42b3-821a-b453b501d302 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:10.127104 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8825c717-6119-42b3-821a-b453b501d302 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:10.127669 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8825c717-6119-42b3-821a-b453b501d302 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:10.128154 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8825c717-6119-42b3-821a-b453b501d302 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:10.145910 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-8825c717-6119-42b3-821a-b453b501d302 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Getting quotas for project 9340222cfe154efe8a6064b197d54499. Resources: {'instances', 'ram', 'cores'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 12:28:10.150883 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-8825c717-6119-42b3-821a-b453b501d302 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Getting quotas for user 8790c086dcaa4da5b739bcd02d30b4c0 and project 9340222cfe154efe8a6064b197d54499. Resources: {'instances', 'ram', 'cores'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 12:28:10.164082 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-8825c717-6119-42b3-821a-b453b501d302 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Going to run 1 instances... {{(pid=120462) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 12:28:10.167475 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-8825c717-6119-42b3-821a-b453b501d302 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e3a8d95-6338-499c-af91-e3d1345af950',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 12:28:10.221054 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-8825c717-6119-42b3-821a-b453b501d302 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.133596 Sep 21 12:28:10.221891 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 377/747] 10.222.0.71 () {60 vars in 1147 bytes} [Wed Sep 21 12:28:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 1135 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 21 12:28:10.233179 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-62c98b31-c3db-422e-9b27-c39ef3af9fd2 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:10.233796 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-62c98b31-c3db-422e-9b27-c39ef3af9fd2 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:10.291237 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-62c98b31-c3db-422e-9b27-c39ef3af9fd2 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:28:10.299289 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-62c98b31-c3db-422e-9b27-c39ef3af9fd2 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c" status: 200 len: 1238 microversion: 2.1 time: 0.070403 Sep 21 12:28:10.299918 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 371/748] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:10 2022] GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:28:11.152454 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-599943ab-9d15-4fcd-a950-eade04fcaaf3 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:11.152950 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-599943ab-9d15-4fcd-a950-eade04fcaaf3 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:11.162420 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-599943ab-9d15-4fcd-a950-eade04fcaaf3 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:11.162926 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-599943ab-9d15-4fcd-a950-eade04fcaaf3 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:11.163362 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-599943ab-9d15-4fcd-a950-eade04fcaaf3 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:11.164146 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-599943ab-9d15-4fcd-a950-eade04fcaaf3 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:11.164598 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-599943ab-9d15-4fcd-a950-eade04fcaaf3 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:11.165021 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-599943ab-9d15-4fcd-a950-eade04fcaaf3 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:11.189440 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-599943ab-9d15-4fcd-a950-eade04fcaaf3 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Going to try to terminate instance {{(pid=120462) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 12:28:11.273092 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-599943ab-9d15-4fcd-a950-eade04fcaaf3 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "DELETE /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 204 len: 0 microversion: 2.1 time: 0.124222 Sep 21 12:28:11.273694 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 378/749] 10.222.0.71 () {58 vars in 1239 bytes} [Wed Sep 21 12:28:11 2022] DELETE /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 21 12:28:11.281869 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-02b5caa6-ba1c-4344-a24c-8037a73023eb tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:11.282572 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-02b5caa6-ba1c-4344-a24c-8037a73023eb tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:11.290133 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-02b5caa6-ba1c-4344-a24c-8037a73023eb tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:11.290620 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-02b5caa6-ba1c-4344-a24c-8037a73023eb tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:11.291062 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-02b5caa6-ba1c-4344-a24c-8037a73023eb tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:11.291842 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-02b5caa6-ba1c-4344-a24c-8037a73023eb tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:11.292244 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-02b5caa6-ba1c-4344-a24c-8037a73023eb tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:11.292673 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-02b5caa6-ba1c-4344-a24c-8037a73023eb tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:11.324672 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-2eedf09a-f8f8-471f-a22d-a39ee4def0ec tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:11.326275 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-2eedf09a-f8f8-471f-a22d-a39ee4def0ec tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:11.333083 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2eedf09a-f8f8-471f-a22d-a39ee4def0ec tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:11.333660 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2eedf09a-f8f8-471f-a22d-a39ee4def0ec tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:11.334384 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2eedf09a-f8f8-471f-a22d-a39ee4def0ec tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:11.335306 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2eedf09a-f8f8-471f-a22d-a39ee4def0ec tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:11.335881 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2eedf09a-f8f8-471f-a22d-a39ee4def0ec tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:11.336311 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2eedf09a-f8f8-471f-a22d-a39ee4def0ec tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:11.419308 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-2eedf09a-f8f8-471f-a22d-a39ee4def0ec tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:28:11.431668 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-2eedf09a-f8f8-471f-a22d-a39ee4def0ec tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c" status: 200 len: 1290 microversion: 2.1 time: 0.112876 Sep 21 12:28:11.432580 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 379/750] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:11 2022] GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c => generated 1290 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:28:11.441935 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-02b5caa6-ba1c-4344-a24c-8037a73023eb tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:28:11.449740 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-02b5caa6-ba1c-4344-a24c-8037a73023eb tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1553 microversion: 2.1 time: 0.171732 Sep 21 12:28:11.450557 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 372/751] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:11 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1553 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:28:12.456053 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-75f57645-a13c-4f58-aa4c-ce449d3ed7c0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:12.456667 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-75f57645-a13c-4f58-aa4c-ce449d3ed7c0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:12.463042 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-75f57645-a13c-4f58-aa4c-ce449d3ed7c0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:12.463521 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-75f57645-a13c-4f58-aa4c-ce449d3ed7c0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:12.463981 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-75f57645-a13c-4f58-aa4c-ce449d3ed7c0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:12.464661 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-75f57645-a13c-4f58-aa4c-ce449d3ed7c0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:12.465106 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-75f57645-a13c-4f58-aa4c-ce449d3ed7c0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:12.465522 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-75f57645-a13c-4f58-aa4c-ce449d3ed7c0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:12.472772 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-5badcf49-0744-423e-aad7-5cba4fefbc15 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:12.473397 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-5badcf49-0744-423e-aad7-5cba4fefbc15 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:12.480434 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5badcf49-0744-423e-aad7-5cba4fefbc15 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:12.480935 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5badcf49-0744-423e-aad7-5cba4fefbc15 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:12.481378 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5badcf49-0744-423e-aad7-5cba4fefbc15 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:12.482119 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5badcf49-0744-423e-aad7-5cba4fefbc15 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:12.482583 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5badcf49-0744-423e-aad7-5cba4fefbc15 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:12.483107 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5badcf49-0744-423e-aad7-5cba4fefbc15 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:12.526838 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-75f57645-a13c-4f58-aa4c-ce449d3ed7c0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:28:12.534462 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-75f57645-a13c-4f58-aa4c-ce449d3ed7c0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c" status: 200 len: 1298 microversion: 2.1 time: 0.082243 Sep 21 12:28:12.535042 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 380/752] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:12 2022] GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c => generated 1298 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:28:12.611077 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-5badcf49-0744-423e-aad7-5cba4fefbc15 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:28:12.618739 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-5badcf49-0744-423e-aad7-5cba4fefbc15 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1553 microversion: 2.1 time: 0.149826 Sep 21 12:28:12.619305 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 373/753] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:12 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:28:13.557821 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-03b39fa0-b5a0-42b1-b093-b0fa7711a966 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:13.558528 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-03b39fa0-b5a0-42b1-b093-b0fa7711a966 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:13.565079 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-03b39fa0-b5a0-42b1-b093-b0fa7711a966 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:13.565568 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-03b39fa0-b5a0-42b1-b093-b0fa7711a966 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:13.566007 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-03b39fa0-b5a0-42b1-b093-b0fa7711a966 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:13.566716 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-03b39fa0-b5a0-42b1-b093-b0fa7711a966 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:13.567286 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-03b39fa0-b5a0-42b1-b093-b0fa7711a966 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:13.567815 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-03b39fa0-b5a0-42b1-b093-b0fa7711a966 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:13.642867 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-bbbbac74-19bd-4bcd-b1e2-a11711d8139e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:13.644091 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-bbbbac74-19bd-4bcd-b1e2-a11711d8139e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:13.644708 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-03b39fa0-b5a0-42b1-b093-b0fa7711a966 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:28:13.651659 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bbbbac74-19bd-4bcd-b1e2-a11711d8139e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:13.652193 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bbbbac74-19bd-4bcd-b1e2-a11711d8139e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:13.652635 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bbbbac74-19bd-4bcd-b1e2-a11711d8139e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:13.653495 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-03b39fa0-b5a0-42b1-b093-b0fa7711a966 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c" status: 200 len: 1296 microversion: 2.1 time: 0.099663 Sep 21 12:28:13.653697 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bbbbac74-19bd-4bcd-b1e2-a11711d8139e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:13.654701 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 381/754] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:13 2022] GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c => generated 1296 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:28:13.654848 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bbbbac74-19bd-4bcd-b1e2-a11711d8139e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:13.655222 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bbbbac74-19bd-4bcd-b1e2-a11711d8139e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:13.797141 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-bbbbac74-19bd-4bcd-b1e2-a11711d8139e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:28:13.805120 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-bbbbac74-19bd-4bcd-b1e2-a11711d8139e tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1553 microversion: 2.1 time: 0.166805 Sep 21 12:28:13.805702 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 374/755] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:13 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:28:14.472556 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-ba758fc4-257a-45e4-9ab1-35e16cce0ea0 req-d9ea9c39-d6ee-444c-ba54-1783849500b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc8e107-efaf-4689-9e8f-f8adc955c6d9", "name": "network-vif-deleted", "tag": "2d86ac1e-8e22-4863-a099-2f5b0b120e07"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:28:14.486266 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-ba758fc4-257a-45e4-9ab1-35e16cce0ea0 req-d9ea9c39-d6ee-444c-ba54-1783849500b3 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:14.487138 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-ba758fc4-257a-45e4-9ab1-35e16cce0ea0 req-d9ea9c39-d6ee-444c-ba54-1783849500b3 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:14.487874 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-ba758fc4-257a-45e4-9ab1-35e16cce0ea0 req-d9ea9c39-d6ee-444c-ba54-1783849500b3 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:14.503748 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-ba758fc4-257a-45e4-9ab1-35e16cce0ea0 req-d9ea9c39-d6ee-444c-ba54-1783849500b3 service nova] Creating event network-vif-deleted:2d86ac1e-8e22-4863-a099-2f5b0b120e07 for instance 3cc8e107-efaf-4689-9e8f-f8adc955c6d9 on hv-cinder-85867 Sep 21 12:28:14.511324 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-ba758fc4-257a-45e4-9ab1-35e16cce0ea0 req-d9ea9c39-d6ee-444c-ba54-1783849500b3 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045252 Sep 21 12:28:14.512057 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 382/756] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:28:14.677461 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-ff89d0a6-725a-4a76-b1ed-635ce1a5bc2f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:14.678826 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-ff89d0a6-725a-4a76-b1ed-635ce1a5bc2f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:14.686041 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ff89d0a6-725a-4a76-b1ed-635ce1a5bc2f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:14.686780 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ff89d0a6-725a-4a76-b1ed-635ce1a5bc2f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:14.687401 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ff89d0a6-725a-4a76-b1ed-635ce1a5bc2f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:14.688279 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ff89d0a6-725a-4a76-b1ed-635ce1a5bc2f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:14.688618 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ff89d0a6-725a-4a76-b1ed-635ce1a5bc2f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:14.689414 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ff89d0a6-725a-4a76-b1ed-635ce1a5bc2f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:14.829532 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-89f93272-bf59-48bf-9170-6012fe60b0b8 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:14.836323 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-89f93272-bf59-48bf-9170-6012fe60b0b8 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:14.847801 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-89f93272-bf59-48bf-9170-6012fe60b0b8 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:14.848303 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-89f93272-bf59-48bf-9170-6012fe60b0b8 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:14.849137 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-89f93272-bf59-48bf-9170-6012fe60b0b8 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:14.850120 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-89f93272-bf59-48bf-9170-6012fe60b0b8 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:14.850820 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-89f93272-bf59-48bf-9170-6012fe60b0b8 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:14.851749 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-89f93272-bf59-48bf-9170-6012fe60b0b8 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:14.868148 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-ff89d0a6-725a-4a76-b1ed-635ce1a5bc2f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:28:14.879455 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-ff89d0a6-725a-4a76-b1ed-635ce1a5bc2f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c" status: 200 len: 1364 microversion: 2.1 time: 0.205643 Sep 21 12:28:14.880254 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 375/757] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:14 2022] GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c => generated 1364 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:28:14.908020 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-89f93272-bf59-48bf-9170-6012fe60b0b8 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:14.908472 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-89f93272-bf59-48bf-9170-6012fe60b0b8 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:14.909182 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-89f93272-bf59-48bf-9170-6012fe60b0b8 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:14.910399 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.objects.instance [None req-89f93272-bf59-48bf-9170-6012fe60b0b8 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lazy-loading 'fault' on Instance uuid 3cc8e107-efaf-4689-9e8f-f8adc955c6d9 {{(pid=120462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 12:28:14.965844 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-89f93272-bf59-48bf-9170-6012fe60b0b8 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e0b6c8f5ec24d478f47a3d8d2fd941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de710fda38c429a91595545e9a74dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:28:14.974431 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-89f93272-bf59-48bf-9170-6012fe60b0b8 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 200 len: 1348 microversion: 2.1 time: 0.149308 Sep 21 12:28:14.975180 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 383/758] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:14 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 1348 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:28:15.904207 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-b519990b-0c2b-4ec9-84fb-b48c3b4feefd tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:15.904855 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-b519990b-0c2b-4ec9-84fb-b48c3b4feefd tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:15.911274 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b519990b-0c2b-4ec9-84fb-b48c3b4feefd tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:15.911782 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b519990b-0c2b-4ec9-84fb-b48c3b4feefd tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:15.912243 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b519990b-0c2b-4ec9-84fb-b48c3b4feefd tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:15.912939 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b519990b-0c2b-4ec9-84fb-b48c3b4feefd tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:15.913398 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b519990b-0c2b-4ec9-84fb-b48c3b4feefd tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:15.913829 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b519990b-0c2b-4ec9-84fb-b48c3b4feefd tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:15.998262 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-78329759-dc09-4710-a3cf-fefcc369ab63 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:15.999013 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-78329759-dc09-4710-a3cf-fefcc369ab63 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] [instance: 3cc8e107-efaf-4689-9e8f-f8adc955c6d9] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:16.005751 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-78329759-dc09-4710-a3cf-fefcc369ab63 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:16.006238 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-78329759-dc09-4710-a3cf-fefcc369ab63 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:16.006681 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-78329759-dc09-4710-a3cf-fefcc369ab63 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:16.007387 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-78329759-dc09-4710-a3cf-fefcc369ab63 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:16.007886 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-78329759-dc09-4710-a3cf-fefcc369ab63 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:16.008316 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-78329759-dc09-4710-a3cf-fefcc369ab63 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:16.024440 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.wsgi [None req-78329759-dc09-4710-a3cf-fefcc369ab63 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] HTTP exception thrown: Instance 3cc8e107-efaf-4689-9e8f-f8adc955c6d9 could not be found. Sep 21 12:28:16.026110 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-78329759-dc09-4710-a3cf-fefcc369ab63 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Request method failure captured: Sep 21 12:28:16.026110 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: request: GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 HTTP/1.1 Sep 21 12:28:16.026110 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept: application/json Sep 21 12:28:16.026110 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept-Encoding: identity Sep 21 12:28:16.026110 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Connection: close Sep 21 12:28:16.026110 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Length: 0 Sep 21 12:28:16.026110 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Type: application/json Sep 21 12:28:16.026110 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Host: 10.222.0.71 Sep 21 12:28:16.026110 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Openstack-System-Scope: None Sep 21 12:28:16.026110 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: User-Agent: python-urllib3/1.26.12 Sep 21 12:28:16.026110 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Auth-Token: gAAAAABjKwJswsf8OtZIVzROIfqcrN35SBfoUyB58J_TeXCpgyvo4zdjR5rB2aYl5p78xGnI1aAsyEMrWMLMuSMmccYKmOWfwJ5JE3M-ED3V_N9_HpvlIXhBykqSYn388HJT_XeaHyWe7vUgYSe_CoulysUFn7nLsF0MHNd3gJagScwtkVCUmYs Sep 21 12:28:16.026110 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Id: None Sep 21 12:28:16.026110 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Name: None Sep 21 12:28:16.026110 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Identity-Status: Confirmed Sep 21 12:28:16.026110 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Is-Admin-Project: True Sep 21 12:28:16.026110 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Id: default Sep 21 12:28:16.026110 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Name: Default Sep 21 12:28:16.026110 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Id: 9de710fda38c429a91595545e9a74dcb Sep 21 12:28:16.026110 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Name: tempest-TestMinimumBasicScenario-394132406 Sep 21 12:28:16.026110 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Role: reader,member Sep 21 12:28:16.026110 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Roles: reader,member Sep 21 12:28:16.028874 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9de710fda38c429a91595545e9a74dcb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9de710fda38c429a91595545e9a74dcb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_9de710fda38c429a91595545e9a74dcb", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/9de710fda38c429a91595545e9a74dcb"}]}] Sep 21 12:28:16.028874 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant: tempest-TestMinimumBasicScenario-394132406 Sep 21 12:28:16.028874 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Id: 9de710fda38c429a91595545e9a74dcb Sep 21 12:28:16.028874 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Name: tempest-TestMinimumBasicScenario-394132406 Sep 21 12:28:16.028874 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User: tempest-TestMinimumBasicScenario-394132406-project Sep 21 12:28:16.028874 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Id: default Sep 21 12:28:16.028874 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Name: Default Sep 21 12:28:16.028874 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Id: 8e0b6c8f5ec24d478f47a3d8d2fd941e Sep 21 12:28:16.028874 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Name: tempest-TestMinimumBasicScenario-394132406-project Sep 21 12:28:16.028874 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: method: > Sep 21 12:28:16.028874 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: exception: Instance 3cc8e107-efaf-4689-9e8f-f8adc955c6d9 could not be found. Sep 21 12:28:16.028874 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: action_args: {'id': '3cc8e107-efaf-4689-9e8f-f8adc955c6d9'} Sep 21 12:28:16.030543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:28:16.030543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:28:16.030543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:28:16.030543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:28:16.030543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:28:16.030543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:28:16.030543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:28:16.030543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:28:16.030543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:28:16.030543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:28:16.030543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cc8e107-efaf-4689-9e8f-f8adc955c6d9 could not be found. Sep 21 12:28:16.030543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:28:16.030543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:28:16.030543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:28:16.030543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:28:16.030543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:28:16.030543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:28:16.030543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:28:16.030543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:28:16.030543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:28:16.033276 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:28:16.033276 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 12:28:16.033276 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 12:28:16.033276 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:28:16.033276 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:28:16.033276 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:28:16.033276 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:28:16.033276 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cc8e107-efaf-4689-9e8f-f8adc955c6d9 could not be found. Sep 21 12:28:16.033276 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:28:16.033276 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:28:16.033276 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:28:16.033276 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:28:16.033276 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:28:16.033276 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:28:16.033276 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:28:16.033276 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:28:16.033276 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cc8e107-efaf-4689-9e8f-f8adc955c6d9 could not be found. Sep 21 12:28:16.033276 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:28:16.035833 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-78329759-dc09-4710-a3cf-fefcc369ab63 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Returning 404 to user: Instance 3cc8e107-efaf-4689-9e8f-f8adc955c6d9 could not be found. {{(pid=120462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:28:16.035833 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-78329759-dc09-4710-a3cf-fefcc369ab63 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9" status: 404 len: 111 microversion: 2.1 time: 0.033889 Sep 21 12:28:16.035833 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 384/759] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:15 2022] GET /compute/v2.1/servers/3cc8e107-efaf-4689-9e8f-f8adc955c6d9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 21 12:28:16.039496 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-d5b350cc-1f9e-4ee6-a6ef-b7c1e94122d7 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] Calling method '.version_select at 0x7fe4c905fca0>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:16.046521 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-b519990b-0c2b-4ec9-84fb-b48c3b4feefd tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:28:16.054300 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-b519990b-0c2b-4ec9-84fb-b48c3b4feefd tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c" status: 200 len: 1364 microversion: 2.1 time: 0.153988 Sep 21 12:28:16.054949 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 376/760] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:15 2022] GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:28:16.070471 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-d5b350cc-1f9e-4ee6-a6ef-b7c1e94122d7 tempest-TestMinimumBasicScenario-394132406 tempest-TestMinimumBasicScenario-394132406-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-325051845" status: 202 len: 0 microversion: 2.1 time: 0.024113 Sep 21 12:28:16.070471 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 385/761] 10.222.0.71 () {58 vars in 1269 bytes} [Wed Sep 21 12:28:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-325051845 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 21 12:28:16.527174 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-89596ed7-02d2-41a6-96ed-3e82259a4870 req-f9d2cb5b-80c6-4261-81e2-b6d2ddfa9726 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f60cc06f-a959-4872-9552-99d76b9f4c7c", "tag": "621b6d40-2773-4228-966f-8aedb5d52908"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:28:16.538094 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-89596ed7-02d2-41a6-96ed-3e82259a4870 req-f9d2cb5b-80c6-4261-81e2-b6d2ddfa9726 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:16.538564 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-89596ed7-02d2-41a6-96ed-3e82259a4870 req-f9d2cb5b-80c6-4261-81e2-b6d2ddfa9726 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:16.538984 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-89596ed7-02d2-41a6-96ed-3e82259a4870 req-f9d2cb5b-80c6-4261-81e2-b6d2ddfa9726 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:16.549536 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-89596ed7-02d2-41a6-96ed-3e82259a4870 req-f9d2cb5b-80c6-4261-81e2-b6d2ddfa9726 service nova] Creating event network-changed:621b6d40-2773-4228-966f-8aedb5d52908 for instance f60cc06f-a959-4872-9552-99d76b9f4c7c on hv-cinder-85867 Sep 21 12:28:16.554462 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-89596ed7-02d2-41a6-96ed-3e82259a4870 req-f9d2cb5b-80c6-4261-81e2-b6d2ddfa9726 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031022 Sep 21 12:28:16.555047 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 386/762] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:28:17.078918 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-d179c958-713f-4c43-a6dd-3ec179972c1e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:17.079553 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-d179c958-713f-4c43-a6dd-3ec179972c1e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:17.086004 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d179c958-713f-4c43-a6dd-3ec179972c1e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:17.086493 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d179c958-713f-4c43-a6dd-3ec179972c1e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:17.086938 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d179c958-713f-4c43-a6dd-3ec179972c1e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:17.087647 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d179c958-713f-4c43-a6dd-3ec179972c1e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:17.088215 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d179c958-713f-4c43-a6dd-3ec179972c1e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:17.088574 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d179c958-713f-4c43-a6dd-3ec179972c1e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:17.269629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-d179c958-713f-4c43-a6dd-3ec179972c1e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:28:17.277564 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-d179c958-713f-4c43-a6dd-3ec179972c1e tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c" status: 200 len: 1364 microversion: 2.1 time: 0.203301 Sep 21 12:28:17.278152 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 377/763] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:17 2022] GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c => generated 1364 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:28:18.301218 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-d3ee93d3-c1ad-46e8-baf2-9c7ae59ee623 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:18.302544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-d3ee93d3-c1ad-46e8-baf2-9c7ae59ee623 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:18.309563 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d3ee93d3-c1ad-46e8-baf2-9c7ae59ee623 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:18.310849 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d3ee93d3-c1ad-46e8-baf2-9c7ae59ee623 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:18.311290 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d3ee93d3-c1ad-46e8-baf2-9c7ae59ee623 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:18.312008 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d3ee93d3-c1ad-46e8-baf2-9c7ae59ee623 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:18.312669 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d3ee93d3-c1ad-46e8-baf2-9c7ae59ee623 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:18.313088 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d3ee93d3-c1ad-46e8-baf2-9c7ae59ee623 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:18.637153 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-d3ee93d3-c1ad-46e8-baf2-9c7ae59ee623 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:28:18.646345 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-d3ee93d3-c1ad-46e8-baf2-9c7ae59ee623 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c" status: 200 len: 1364 microversion: 2.1 time: 0.349469 Sep 21 12:28:18.647156 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 387/764] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:18 2022] GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c => generated 1364 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:28:19.673179 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-a0a4b1a6-6f64-4a0a-b2a6-c892dffe40a8 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:19.673809 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-a0a4b1a6-6f64-4a0a-b2a6-c892dffe40a8 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:19.680637 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a0a4b1a6-6f64-4a0a-b2a6-c892dffe40a8 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:19.681128 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a0a4b1a6-6f64-4a0a-b2a6-c892dffe40a8 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:19.681583 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a0a4b1a6-6f64-4a0a-b2a6-c892dffe40a8 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:19.682292 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a0a4b1a6-6f64-4a0a-b2a6-c892dffe40a8 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:19.683147 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a0a4b1a6-6f64-4a0a-b2a6-c892dffe40a8 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:19.683592 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a0a4b1a6-6f64-4a0a-b2a6-c892dffe40a8 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:19.885458 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a0a4b1a6-6f64-4a0a-b2a6-c892dffe40a8 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:28:19.894858 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-a0a4b1a6-6f64-4a0a-b2a6-c892dffe40a8 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c" status: 200 len: 1364 microversion: 2.1 time: 0.228461 Sep 21 12:28:19.911558 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 378/765] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:19 2022] GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:28:20.918775 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-8eebfdcc-1bf4-41c8-a24e-8cf9137d30c2 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:20.919989 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-8eebfdcc-1bf4-41c8-a24e-8cf9137d30c2 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:20.922483 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell0:SELECT=2 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:20.923150 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell0:SELECT=6 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:20.928905 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8eebfdcc-1bf4-41c8-a24e-8cf9137d30c2 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:20.929408 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8eebfdcc-1bf4-41c8-a24e-8cf9137d30c2 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:20.929852 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8eebfdcc-1bf4-41c8-a24e-8cf9137d30c2 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:20.930560 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8eebfdcc-1bf4-41c8-a24e-8cf9137d30c2 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:20.931021 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8eebfdcc-1bf4-41c8-a24e-8cf9137d30c2 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:20.931457 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8eebfdcc-1bf4-41c8-a24e-8cf9137d30c2 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:20.949938 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:21.221414 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-8eebfdcc-1bf4-41c8-a24e-8cf9137d30c2 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:28:21.229055 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-8eebfdcc-1bf4-41c8-a24e-8cf9137d30c2 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c" status: 200 len: 1364 microversion: 2.1 time: 0.314114 Sep 21 12:28:21.229627 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 388/766] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:20 2022] GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c => generated 1364 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:28:21.987399 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-e6f100ac-6a38-4ffe-a09e-224b52ea36bc req-b3cc53ef-348e-44e5-8982-18f9b7e2be80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f60cc06f-a959-4872-9552-99d76b9f4c7c", "name": "network-vif-plugged", "status": "completed", "tag": "621b6d40-2773-4228-966f-8aedb5d52908"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:28:21.992484 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell0:SELECT=6 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:22.001486 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-e6f100ac-6a38-4ffe-a09e-224b52ea36bc req-b3cc53ef-348e-44e5-8982-18f9b7e2be80 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:22.002170 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-e6f100ac-6a38-4ffe-a09e-224b52ea36bc req-b3cc53ef-348e-44e5-8982-18f9b7e2be80 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:22.002622 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-e6f100ac-6a38-4ffe-a09e-224b52ea36bc req-b3cc53ef-348e-44e5-8982-18f9b7e2be80 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:22.014859 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-e6f100ac-6a38-4ffe-a09e-224b52ea36bc req-b3cc53ef-348e-44e5-8982-18f9b7e2be80 service nova] Creating event network-vif-plugged:621b6d40-2773-4228-966f-8aedb5d52908 for instance f60cc06f-a959-4872-9552-99d76b9f4c7c on hv-cinder-85867 Sep 21 12:28:22.020196 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-e6f100ac-6a38-4ffe-a09e-224b52ea36bc req-b3cc53ef-348e-44e5-8982-18f9b7e2be80 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036397 Sep 21 12:28:22.021017 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 379/767] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:28:22.253211 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-58020e55-3bce-4527-b60d-c7200784c113 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:22.254684 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-58020e55-3bce-4527-b60d-c7200784c113 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:22.262236 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-58020e55-3bce-4527-b60d-c7200784c113 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:22.263260 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-58020e55-3bce-4527-b60d-c7200784c113 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:22.263953 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-58020e55-3bce-4527-b60d-c7200784c113 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:22.265267 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-58020e55-3bce-4527-b60d-c7200784c113 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:22.265814 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-58020e55-3bce-4527-b60d-c7200784c113 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:22.266726 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-58020e55-3bce-4527-b60d-c7200784c113 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:22.424737 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-58020e55-3bce-4527-b60d-c7200784c113 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:28:22.434010 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-58020e55-3bce-4527-b60d-c7200784c113 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c" status: 200 len: 1364 microversion: 2.1 time: 0.184978 Sep 21 12:28:22.435308 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 389/768] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:22 2022] GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:28:23.459618 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-589f5958-3d2d-469e-a115-65896796d8eb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:23.460268 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-589f5958-3d2d-469e-a115-65896796d8eb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:23.467872 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-589f5958-3d2d-469e-a115-65896796d8eb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:23.468363 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-589f5958-3d2d-469e-a115-65896796d8eb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:23.468802 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-589f5958-3d2d-469e-a115-65896796d8eb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:23.469624 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-589f5958-3d2d-469e-a115-65896796d8eb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:23.470124 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-589f5958-3d2d-469e-a115-65896796d8eb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:23.470570 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-589f5958-3d2d-469e-a115-65896796d8eb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:23.618126 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-589f5958-3d2d-469e-a115-65896796d8eb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:28:23.638483 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-589f5958-3d2d-469e-a115-65896796d8eb tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c" status: 200 len: 1364 microversion: 2.1 time: 0.182577 Sep 21 12:28:23.639735 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 380/769] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:23 2022] GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:28:24.662142 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-f744405d-c39e-4981-8e76-a8e142d5c64f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:24.662935 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-f744405d-c39e-4981-8e76-a8e142d5c64f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:24.670411 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f744405d-c39e-4981-8e76-a8e142d5c64f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:24.671101 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f744405d-c39e-4981-8e76-a8e142d5c64f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:24.671553 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f744405d-c39e-4981-8e76-a8e142d5c64f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:24.672308 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f744405d-c39e-4981-8e76-a8e142d5c64f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:24.672739 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f744405d-c39e-4981-8e76-a8e142d5c64f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:24.673237 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f744405d-c39e-4981-8e76-a8e142d5c64f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:24.804427 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-f744405d-c39e-4981-8e76-a8e142d5c64f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:28:24.812742 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-f744405d-c39e-4981-8e76-a8e142d5c64f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c" status: 200 len: 1549 microversion: 2.1 time: 0.154749 Sep 21 12:28:24.813243 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 390/770] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:24 2022] GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:28:24.835524 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-46368b6d-7f8c-4915-85b0-f8fb29b26acf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:24.836089 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-46368b6d-7f8c-4915-85b0-f8fb29b26acf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:24.843040 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-46368b6d-7f8c-4915-85b0-f8fb29b26acf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:24.843523 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-46368b6d-7f8c-4915-85b0-f8fb29b26acf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:24.843987 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-46368b6d-7f8c-4915-85b0-f8fb29b26acf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:24.844683 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-46368b6d-7f8c-4915-85b0-f8fb29b26acf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:24.845137 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-46368b6d-7f8c-4915-85b0-f8fb29b26acf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:24.845561 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-46368b6d-7f8c-4915-85b0-f8fb29b26acf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:24.951359 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-46368b6d-7f8c-4915-85b0-f8fb29b26acf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.119654 Sep 21 12:28:24.952075 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 381/771] 10.222.0.71 () {58 vars in 1275 bytes} [Wed Sep 21 12:28:24 2022] GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:28:25.978497 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-916097ae-dcd2-4882-893d-d8e98f78dc0d req-5429dd4a-3322-4354-b89c-2c94a90a5acd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f60cc06f-a959-4872-9552-99d76b9f4c7c", "tag": "621b6d40-2773-4228-966f-8aedb5d52908"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:28:25.990249 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-916097ae-dcd2-4882-893d-d8e98f78dc0d req-5429dd4a-3322-4354-b89c-2c94a90a5acd service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:25.991149 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-916097ae-dcd2-4882-893d-d8e98f78dc0d req-5429dd4a-3322-4354-b89c-2c94a90a5acd service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:25.991741 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-916097ae-dcd2-4882-893d-d8e98f78dc0d req-5429dd4a-3322-4354-b89c-2c94a90a5acd service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:26.003997 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-916097ae-dcd2-4882-893d-d8e98f78dc0d req-5429dd4a-3322-4354-b89c-2c94a90a5acd service nova] Creating event network-changed:621b6d40-2773-4228-966f-8aedb5d52908 for instance f60cc06f-a959-4872-9552-99d76b9f4c7c on hv-cinder-85867 Sep 21 12:28:26.008963 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-916097ae-dcd2-4882-893d-d8e98f78dc0d req-5429dd4a-3322-4354-b89c-2c94a90a5acd service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034069 Sep 21 12:28:26.010082 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 391/772] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:28:35.213103 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:35.214962 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=94 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:35.399114 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-dee5b74c-c4d9-48cc-8f60-102fa050ca84 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Action: 'create', calling method: .version_select at 0x7fe4c8df8700>, body: {"keypair": {"name": "tempest-TestShelveInstance-250182085", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKfFty0Hws8xoBUBHGw8Zl8UjdycIb/Eyg2qg95IPSW2JDRW4/WHMDmFbTEUQtf7XCGK2lhyoXoA3kstijyfAT2qm8CHkduNC/mLJJcyQKQA/Bqc9DuawNIuR0yQ9yusA=="}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:28:35.415702 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.quota [None req-dee5b74c-c4d9-48cc-8f60-102fa050ca84 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Getting quotas for project 95515a2858124583ac138aa6350e4bc3. Resources: {'key_pairs'} {{(pid=120463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 12:28:35.420246 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.quota [None req-dee5b74c-c4d9-48cc-8f60-102fa050ca84 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Getting quotas for user 94c4cdfb0f264398a7d3b155a9523b11 and project 95515a2858124583ac138aa6350e4bc3. Resources: {'key_pairs'} {{(pid=120463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 12:28:35.445626 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-dee5b74c-c4d9-48cc-8f60-102fa050ca84 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.233948 Sep 21 12:28:35.446237 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 382/773] 10.222.0.71 () {60 vars in 1159 bytes} [Wed Sep 21 12:28:35 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:28:42.060228 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:42.060980 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=16 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:42.065419 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-21850814-62a2-4706-b42c-78e83ff2400b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:42.066011 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-21850814-62a2-4706-b42c-78e83ff2400b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:42.073785 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-21850814-62a2-4706-b42c-78e83ff2400b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:42.075311 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-21850814-62a2-4706-b42c-78e83ff2400b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:42.075798 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-21850814-62a2-4706-b42c-78e83ff2400b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:42.076857 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-21850814-62a2-4706-b42c-78e83ff2400b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:42.077322 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-21850814-62a2-4706-b42c-78e83ff2400b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:42.077752 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-21850814-62a2-4706-b42c-78e83ff2400b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:42.166534 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.objects.instance [None req-21850814-62a2-4706-b42c-78e83ff2400b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lazy-loading 'services' on Instance uuid 5f4f10b5-8953-4c76-a286-6974d7c88433 {{(pid=120462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 12:28:42.241325 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-21850814-62a2-4706-b42c-78e83ff2400b tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "DELETE /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433/os-volume_attachments/ecc73aa7-7c05-45d1-9559-ccffa3dfb570" status: 202 len: 0 microversion: 2.1 time: 0.182608 Sep 21 12:28:42.241924 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 392/774] 10.222.0.71 () {58 vars in 1416 bytes} [Wed Sep 21 12:28:42 2022] DELETE /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433/os-volume_attachments/ecc73aa7-7c05-45d1-9559-ccffa3dfb570 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 12:28:42.250420 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-32f3af72-83b5-48df-92e6-1e78e968bfc7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:42.252659 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-32f3af72-83b5-48df-92e6-1e78e968bfc7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:42.261510 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-32f3af72-83b5-48df-92e6-1e78e968bfc7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:42.263009 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-32f3af72-83b5-48df-92e6-1e78e968bfc7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:42.263373 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-32f3af72-83b5-48df-92e6-1e78e968bfc7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:42.264119 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-32f3af72-83b5-48df-92e6-1e78e968bfc7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:42.264602 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-32f3af72-83b5-48df-92e6-1e78e968bfc7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:42.265069 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-32f3af72-83b5-48df-92e6-1e78e968bfc7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:42.297064 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-32f3af72-83b5-48df-92e6-1e78e968bfc7 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050529 Sep 21 12:28:42.297660 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 383/775] 10.222.0.71 () {58 vars in 1302 bytes} [Wed Sep 21 12:28:42 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:28:43.310890 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-c7a8ab1f-f7b7-4695-b881-0c9723c23463 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:43.313049 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-c7a8ab1f-f7b7-4695-b881-0c9723c23463 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:43.320055 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c7a8ab1f-f7b7-4695-b881-0c9723c23463 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:43.320561 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c7a8ab1f-f7b7-4695-b881-0c9723c23463 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:43.320988 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c7a8ab1f-f7b7-4695-b881-0c9723c23463 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:43.321686 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c7a8ab1f-f7b7-4695-b881-0c9723c23463 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:43.322145 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c7a8ab1f-f7b7-4695-b881-0c9723c23463 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:43.322634 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c7a8ab1f-f7b7-4695-b881-0c9723c23463 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:43.354899 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-c7a8ab1f-f7b7-4695-b881-0c9723c23463 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049047 Sep 21 12:28:43.356214 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 393/776] 10.222.0.71 () {58 vars in 1302 bytes} [Wed Sep 21 12:28:43 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:28:44.368444 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-2d67f44d-4d6b-4faa-a120-330fc192ae71 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:44.370877 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-2d67f44d-4d6b-4faa-a120-330fc192ae71 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:44.378255 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2d67f44d-4d6b-4faa-a120-330fc192ae71 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:44.378750 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2d67f44d-4d6b-4faa-a120-330fc192ae71 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:44.379192 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2d67f44d-4d6b-4faa-a120-330fc192ae71 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:44.379926 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2d67f44d-4d6b-4faa-a120-330fc192ae71 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:44.380393 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2d67f44d-4d6b-4faa-a120-330fc192ae71 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:44.380824 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2d67f44d-4d6b-4faa-a120-330fc192ae71 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:44.412690 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-2d67f44d-4d6b-4faa-a120-330fc192ae71 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048700 Sep 21 12:28:44.413261 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 384/777] 10.222.0.71 () {58 vars in 1302 bytes} [Wed Sep 21 12:28:44 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 21 12:28:44.498942 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-beede26b-9016-459e-87a3-36da6b73abbd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:44.499564 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-beede26b-9016-459e-87a3-36da6b73abbd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:44.506423 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-beede26b-9016-459e-87a3-36da6b73abbd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:44.506908 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-beede26b-9016-459e-87a3-36da6b73abbd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:44.507340 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-beede26b-9016-459e-87a3-36da6b73abbd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:44.508172 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-beede26b-9016-459e-87a3-36da6b73abbd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:44.508697 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-beede26b-9016-459e-87a3-36da6b73abbd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:44.509138 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-beede26b-9016-459e-87a3-36da6b73abbd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:44.534159 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-beede26b-9016-459e-87a3-36da6b73abbd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Going to try to terminate instance {{(pid=120462) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 12:28:44.609915 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-beede26b-9016-459e-87a3-36da6b73abbd tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "DELETE /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 204 len: 0 microversion: 2.1 time: 0.115126 Sep 21 12:28:44.611022 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 394/778] 10.222.0.71 () {58 vars in 1239 bytes} [Wed Sep 21 12:28:44 2022] DELETE /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 21 12:28:44.619233 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-cdba0120-31dd-42e9-9962-cc32823588a4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:44.619879 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-cdba0120-31dd-42e9-9962-cc32823588a4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:44.625946 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cdba0120-31dd-42e9-9962-cc32823588a4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:44.626372 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cdba0120-31dd-42e9-9962-cc32823588a4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:44.626816 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cdba0120-31dd-42e9-9962-cc32823588a4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:44.627511 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cdba0120-31dd-42e9-9962-cc32823588a4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:44.628002 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cdba0120-31dd-42e9-9962-cc32823588a4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:44.628436 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cdba0120-31dd-42e9-9962-cc32823588a4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:44.983047 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-cdba0120-31dd-42e9-9962-cc32823588a4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:28:44.991172 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-cdba0120-31dd-42e9-9962-cc32823588a4 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1688 microversion: 2.1 time: 0.376024 Sep 21 12:28:44.991778 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 385/779] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:44 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1688 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:28:46.015858 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-2f36dc55-ab53-4e77-b8ef-cea119deef16 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:46.016506 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-2f36dc55-ab53-4e77-b8ef-cea119deef16 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:46.022905 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2f36dc55-ab53-4e77-b8ef-cea119deef16 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:46.023409 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2f36dc55-ab53-4e77-b8ef-cea119deef16 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:46.023856 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2f36dc55-ab53-4e77-b8ef-cea119deef16 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:46.024558 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2f36dc55-ab53-4e77-b8ef-cea119deef16 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:46.025277 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2f36dc55-ab53-4e77-b8ef-cea119deef16 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:46.025705 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2f36dc55-ab53-4e77-b8ef-cea119deef16 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:46.158462 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-2f36dc55-ab53-4e77-b8ef-cea119deef16 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:28:46.166855 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-2f36dc55-ab53-4e77-b8ef-cea119deef16 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1688 microversion: 2.1 time: 0.155913 Sep 21 12:28:46.167442 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 395/780] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:46 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:28:47.190666 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-5bef5f45-88f1-4ffe-bd93-3d05fd1000f3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:47.191281 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-5bef5f45-88f1-4ffe-bd93-3d05fd1000f3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:47.193656 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell0:SELECT=4 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:47.199611 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5bef5f45-88f1-4ffe-bd93-3d05fd1000f3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:47.200135 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5bef5f45-88f1-4ffe-bd93-3d05fd1000f3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:47.200588 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5bef5f45-88f1-4ffe-bd93-3d05fd1000f3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:47.201292 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5bef5f45-88f1-4ffe-bd93-3d05fd1000f3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:47.201747 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5bef5f45-88f1-4ffe-bd93-3d05fd1000f3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:47.202177 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5bef5f45-88f1-4ffe-bd93-3d05fd1000f3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:47.336772 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-5bef5f45-88f1-4ffe-bd93-3d05fd1000f3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:28:47.344935 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-5bef5f45-88f1-4ffe-bd93-3d05fd1000f3 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1688 microversion: 2.1 time: 0.158109 Sep 21 12:28:47.345531 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 386/781] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:47 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:28:48.368556 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-fec5edbb-009e-4aa9-84b9-155a1de0a1af tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:48.369199 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-fec5edbb-009e-4aa9-84b9-155a1de0a1af tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:48.376136 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fec5edbb-009e-4aa9-84b9-155a1de0a1af tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:48.376621 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fec5edbb-009e-4aa9-84b9-155a1de0a1af tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:48.377059 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fec5edbb-009e-4aa9-84b9-155a1de0a1af tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:48.377749 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fec5edbb-009e-4aa9-84b9-155a1de0a1af tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:48.378202 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fec5edbb-009e-4aa9-84b9-155a1de0a1af tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:48.378629 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fec5edbb-009e-4aa9-84b9-155a1de0a1af tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:48.510778 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-fec5edbb-009e-4aa9-84b9-155a1de0a1af tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:28:48.519594 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-fec5edbb-009e-4aa9-84b9-155a1de0a1af tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1688 microversion: 2.1 time: 0.154804 Sep 21 12:28:48.520385 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 396/782] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:48 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:28:49.542976 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-17627086-9aac-4bd3-ac53-c99fa2ab192a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:49.543654 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-17627086-9aac-4bd3-ac53-c99fa2ab192a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:49.550012 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-17627086-9aac-4bd3-ac53-c99fa2ab192a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:49.550555 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-17627086-9aac-4bd3-ac53-c99fa2ab192a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:49.550993 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-17627086-9aac-4bd3-ac53-c99fa2ab192a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:49.551690 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-17627086-9aac-4bd3-ac53-c99fa2ab192a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:49.552207 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-17627086-9aac-4bd3-ac53-c99fa2ab192a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:49.552608 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-17627086-9aac-4bd3-ac53-c99fa2ab192a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:49.627623 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-17627086-9aac-4bd3-ac53-c99fa2ab192a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:28:49.635398 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-17627086-9aac-4bd3-ac53-c99fa2ab192a tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1621 microversion: 2.1 time: 0.096327 Sep 21 12:28:49.636013 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 387/783] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:49 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1621 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:28:49.935846 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-cdb07d44-e024-45c8-8f35-a17660401a02 req-0b03854e-20e1-471e-8bd7-a13ca2e1c6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f4f10b5-8953-4c76-a286-6974d7c88433", "name": "network-vif-deleted", "tag": "0b66debc-125c-4397-a41e-08b95892a114"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:28:49.967231 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-cdb07d44-e024-45c8-8f35-a17660401a02 req-0b03854e-20e1-471e-8bd7-a13ca2e1c6f1 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:49.968034 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-cdb07d44-e024-45c8-8f35-a17660401a02 req-0b03854e-20e1-471e-8bd7-a13ca2e1c6f1 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:49.968627 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-cdb07d44-e024-45c8-8f35-a17660401a02 req-0b03854e-20e1-471e-8bd7-a13ca2e1c6f1 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:49.983499 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-cdb07d44-e024-45c8-8f35-a17660401a02 req-0b03854e-20e1-471e-8bd7-a13ca2e1c6f1 service nova] Creating event network-vif-deleted:0b66debc-125c-4397-a41e-08b95892a114 for instance 5f4f10b5-8953-4c76-a286-6974d7c88433 on hv-cinder-85867 Sep 21 12:28:49.988918 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-cdb07d44-e024-45c8-8f35-a17660401a02 req-0b03854e-20e1-471e-8bd7-a13ca2e1c6f1 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057135 Sep 21 12:28:49.989535 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 397/784] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:28:50.658959 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-7ba94564-9961-45d8-a5b1-9b0253906971 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:50.659581 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-7ba94564-9961-45d8-a5b1-9b0253906971 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:50.668008 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7ba94564-9961-45d8-a5b1-9b0253906971 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:50.668501 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7ba94564-9961-45d8-a5b1-9b0253906971 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:50.669594 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7ba94564-9961-45d8-a5b1-9b0253906971 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:50.673118 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7ba94564-9961-45d8-a5b1-9b0253906971 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:50.673851 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7ba94564-9961-45d8-a5b1-9b0253906971 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:50.674305 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7ba94564-9961-45d8-a5b1-9b0253906971 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:50.716638 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7ba94564-9961-45d8-a5b1-9b0253906971 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:50.717201 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7ba94564-9961-45d8-a5b1-9b0253906971 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:50.717782 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7ba94564-9961-45d8-a5b1-9b0253906971 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:50.718309 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.objects.instance [None req-7ba94564-9961-45d8-a5b1-9b0253906971 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lazy-loading 'fault' on Instance uuid 5f4f10b5-8953-4c76-a286-6974d7c88433 {{(pid=120463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 12:28:50.762926 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-7ba94564-9961-45d8-a5b1-9b0253906971 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:28:50.771187 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-7ba94564-9961-45d8-a5b1-9b0253906971 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 200 len: 1335 microversion: 2.1 time: 0.116007 Sep 21 12:28:50.771804 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 388/785] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:50 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 1335 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:28:51.796057 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-0817b2a5-1e17-4e5e-a478-f8f3b630726f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:51.796747 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-0817b2a5-1e17-4e5e-a478-f8f3b630726f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5f4f10b5-8953-4c76-a286-6974d7c88433] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:51.802831 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0817b2a5-1e17-4e5e-a478-f8f3b630726f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:51.803309 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0817b2a5-1e17-4e5e-a478-f8f3b630726f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:51.803745 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0817b2a5-1e17-4e5e-a478-f8f3b630726f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:51.804562 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0817b2a5-1e17-4e5e-a478-f8f3b630726f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:51.804932 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0817b2a5-1e17-4e5e-a478-f8f3b630726f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:51.805350 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0817b2a5-1e17-4e5e-a478-f8f3b630726f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:51.819081 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.wsgi [None req-0817b2a5-1e17-4e5e-a478-f8f3b630726f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] HTTP exception thrown: Instance 5f4f10b5-8953-4c76-a286-6974d7c88433 could not be found. Sep 21 12:28:51.820740 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-0817b2a5-1e17-4e5e-a478-f8f3b630726f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Request method failure captured: Sep 21 12:28:51.820740 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: request: GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 HTTP/1.1 Sep 21 12:28:51.820740 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept: application/json Sep 21 12:28:51.820740 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept-Encoding: identity Sep 21 12:28:51.820740 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Connection: close Sep 21 12:28:51.820740 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Length: 0 Sep 21 12:28:51.820740 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Type: application/json Sep 21 12:28:51.820740 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Host: 10.222.0.71 Sep 21 12:28:51.820740 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Openstack-System-Scope: None Sep 21 12:28:51.820740 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: User-Agent: python-urllib3/1.26.12 Sep 21 12:28:51.820740 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Auth-Token: gAAAAABjKwIu3mnwMp4ApNIfIkJUKxsVNJlj-i9y2ZniVDXL-EUHk78SFz38tXU5y8GhQ-eemD725G2hynLgc-_b-6YI8t1ZBLfru0cqJKYCMo5RetnJGUB4BU8XXayroqGJwhgW8Hog1xUJ-Zgaw42z7TLv76VdJCVDouWswH2FyTkqoFyyieY Sep 21 12:28:51.820740 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Id: None Sep 21 12:28:51.820740 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Name: None Sep 21 12:28:51.820740 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Identity-Status: Confirmed Sep 21 12:28:51.820740 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Is-Admin-Project: True Sep 21 12:28:51.820740 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Id: default Sep 21 12:28:51.820740 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Name: Default Sep 21 12:28:51.820740 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Id: d3bd02ae79fd4edb9886b1b4ef3d761a Sep 21 12:28:51.820740 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-914007599 Sep 21 12:28:51.820740 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Role: reader,member Sep 21 12:28:51.820740 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Roles: reader,member Sep 21 12:28:51.822439 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/d3bd02ae79fd4edb9886b1b4ef3d761a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/d3bd02ae79fd4edb9886b1b4ef3d761a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_d3bd02ae79fd4edb9886b1b4ef3d761a", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/d3bd02ae79fd4edb9886b1b4ef3d761a"}]}] Sep 21 12:28:51.822439 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant: tempest-ServerRescueNegativeTestJSON-914007599 Sep 21 12:28:51.822439 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Id: d3bd02ae79fd4edb9886b1b4ef3d761a Sep 21 12:28:51.822439 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-914007599 Sep 21 12:28:51.822439 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User: tempest-ServerRescueNegativeTestJSON-914007599-project Sep 21 12:28:51.822439 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Id: default Sep 21 12:28:51.822439 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Name: Default Sep 21 12:28:51.822439 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Id: 0fb9105e474a4a29904722b1e33d0155 Sep 21 12:28:51.822439 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Name: tempest-ServerRescueNegativeTestJSON-914007599-project Sep 21 12:28:51.822439 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: method: > Sep 21 12:28:51.822439 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: exception: Instance 5f4f10b5-8953-4c76-a286-6974d7c88433 could not be found. Sep 21 12:28:51.822439 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: action_args: {'id': '5f4f10b5-8953-4c76-a286-6974d7c88433'} Sep 21 12:28:51.823368 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:28:51.823368 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:28:51.823368 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:28:51.823368 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:28:51.823368 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:28:51.823368 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:28:51.823368 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:28:51.823368 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:28:51.823368 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:28:51.823368 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:28:51.823368 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f4f10b5-8953-4c76-a286-6974d7c88433 could not be found. Sep 21 12:28:51.823368 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:28:51.823368 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:28:51.823368 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:28:51.823368 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:28:51.823368 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:28:51.823368 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:28:51.823368 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:28:51.823368 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:28:51.823368 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:28:51.825204 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:28:51.825204 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 12:28:51.825204 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 12:28:51.825204 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:28:51.825204 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:28:51.825204 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:28:51.825204 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:28:51.825204 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f4f10b5-8953-4c76-a286-6974d7c88433 could not be found. Sep 21 12:28:51.825204 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:28:51.825204 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:28:51.825204 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:28:51.825204 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:28:51.825204 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:28:51.825204 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:28:51.825204 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:28:51.825204 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:28:51.825204 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f4f10b5-8953-4c76-a286-6974d7c88433 could not be found. Sep 21 12:28:51.825204 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:28:51.826586 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-0817b2a5-1e17-4e5e-a478-f8f3b630726f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Returning 404 to user: Instance 5f4f10b5-8953-4c76-a286-6974d7c88433 could not be found. {{(pid=120462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:28:51.826586 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-0817b2a5-1e17-4e5e-a478-f8f3b630726f tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433" status: 404 len: 111 microversion: 2.1 time: 0.031252 Sep 21 12:28:51.826586 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 398/786] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:51 2022] GET /compute/v2.1/servers/5f4f10b5-8953-4c76-a286-6974d7c88433 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:28:51.830951 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-ed358f60-d079-451d-b00b-96f16d26f718 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '.version_select at 0x7fe4c8cd5820>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:51.851898 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-ed358f60-d079-451d-b00b-96f16d26f718 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1178823482" status: 202 len: 0 microversion: 2.1 time: 0.024643 Sep 21 12:28:51.852483 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 389/787] 10.222.0.71 () {58 vars in 1221 bytes} [Wed Sep 21 12:28:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1178823482 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 12:28:54.706835 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-738fd47d-de8e-4901-ac62-2f0c5a7c1852 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:54.707322 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-738fd47d-de8e-4901-ac62-2f0c5a7c1852 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:54.713878 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-738fd47d-de8e-4901-ac62-2f0c5a7c1852 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:54.714395 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-738fd47d-de8e-4901-ac62-2f0c5a7c1852 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:54.714832 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-738fd47d-de8e-4901-ac62-2f0c5a7c1852 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:54.715555 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-738fd47d-de8e-4901-ac62-2f0c5a7c1852 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:54.716052 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-738fd47d-de8e-4901-ac62-2f0c5a7c1852 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:54.716481 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-738fd47d-de8e-4901-ac62-2f0c5a7c1852 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:54.743510 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-738fd47d-de8e-4901-ac62-2f0c5a7c1852 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Going to try to terminate instance {{(pid=120462) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 12:28:54.820728 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-738fd47d-de8e-4901-ac62-2f0c5a7c1852 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "DELETE /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 204 len: 0 microversion: 2.1 time: 0.117444 Sep 21 12:28:54.821314 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 399/788] 10.222.0.71 () {58 vars in 1239 bytes} [Wed Sep 21 12:28:54 2022] DELETE /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 21 12:28:54.830306 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-4b566ee7-9794-4a21-a755-7d25d1c9d068 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:54.830955 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-4b566ee7-9794-4a21-a755-7d25d1c9d068 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:54.837672 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4b566ee7-9794-4a21-a755-7d25d1c9d068 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:54.838160 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4b566ee7-9794-4a21-a755-7d25d1c9d068 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:54.838603 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4b566ee7-9794-4a21-a755-7d25d1c9d068 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:54.839293 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4b566ee7-9794-4a21-a755-7d25d1c9d068 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:54.839748 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4b566ee7-9794-4a21-a755-7d25d1c9d068 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:54.840241 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4b566ee7-9794-4a21-a755-7d25d1c9d068 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:54.969836 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-4b566ee7-9794-4a21-a755-7d25d1c9d068 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:28:54.977478 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-4b566ee7-9794-4a21-a755-7d25d1c9d068 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1509 microversion: 2.1 time: 0.151594 Sep 21 12:28:54.978054 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 390/789] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:54 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:28:56.001542 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-1e850791-7da3-4c01-aaf6-7a71e176d715 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:56.002278 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-1e850791-7da3-4c01-aaf6-7a71e176d715 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:56.008686 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1e850791-7da3-4c01-aaf6-7a71e176d715 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:56.009175 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1e850791-7da3-4c01-aaf6-7a71e176d715 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:56.009616 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1e850791-7da3-4c01-aaf6-7a71e176d715 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:56.010309 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1e850791-7da3-4c01-aaf6-7a71e176d715 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:56.010765 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1e850791-7da3-4c01-aaf6-7a71e176d715 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:56.011192 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1e850791-7da3-4c01-aaf6-7a71e176d715 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:56.155882 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-1e850791-7da3-4c01-aaf6-7a71e176d715 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:28:56.163594 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-1e850791-7da3-4c01-aaf6-7a71e176d715 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1509 microversion: 2.1 time: 0.166847 Sep 21 12:28:56.164181 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 400/790] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:55 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:28:57.186728 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-a9a309de-7b57-492c-9c7f-0dece086ed34 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:57.187354 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-a9a309de-7b57-492c-9c7f-0dece086ed34 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:57.193758 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a9a309de-7b57-492c-9c7f-0dece086ed34 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:57.194246 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a9a309de-7b57-492c-9c7f-0dece086ed34 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:57.194692 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a9a309de-7b57-492c-9c7f-0dece086ed34 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:57.195392 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a9a309de-7b57-492c-9c7f-0dece086ed34 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:57.195881 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a9a309de-7b57-492c-9c7f-0dece086ed34 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:57.196317 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a9a309de-7b57-492c-9c7f-0dece086ed34 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:57.330030 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a9a309de-7b57-492c-9c7f-0dece086ed34 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:28:57.337828 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-a9a309de-7b57-492c-9c7f-0dece086ed34 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1509 microversion: 2.1 time: 0.154984 Sep 21 12:28:57.338414 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 391/791] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:57 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:28:57.692635 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-ea1f087f-bdb0-4c98-88ee-ff2fd2880564 req-d29dd0ae-630d-40ca-8200-59294ef67f5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de0f1a98-9419-4e35-b8e0-520c7fc482fb", "name": "network-vif-deleted", "tag": "16f7d649-433e-42b0-aede-b34b15fd092f"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:28:57.703273 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-ea1f087f-bdb0-4c98-88ee-ff2fd2880564 req-d29dd0ae-630d-40ca-8200-59294ef67f5b service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:57.703775 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-ea1f087f-bdb0-4c98-88ee-ff2fd2880564 req-d29dd0ae-630d-40ca-8200-59294ef67f5b service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:57.704222 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-ea1f087f-bdb0-4c98-88ee-ff2fd2880564 req-d29dd0ae-630d-40ca-8200-59294ef67f5b service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:57.715739 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-ea1f087f-bdb0-4c98-88ee-ff2fd2880564 req-d29dd0ae-630d-40ca-8200-59294ef67f5b service nova] Creating event network-vif-deleted:16f7d649-433e-42b0-aede-b34b15fd092f for instance de0f1a98-9419-4e35-b8e0-520c7fc482fb on hv-cinder-85867 Sep 21 12:28:57.720830 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-ea1f087f-bdb0-4c98-88ee-ff2fd2880564 req-d29dd0ae-630d-40ca-8200-59294ef67f5b service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031784 Sep 21 12:28:57.724649 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 401/792] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:28:58.361081 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-7b018a3a-42cf-4455-b9f4-3b4aac39954d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:58.361799 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-7b018a3a-42cf-4455-b9f4-3b4aac39954d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:58.368236 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7b018a3a-42cf-4455-b9f4-3b4aac39954d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:58.368728 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7b018a3a-42cf-4455-b9f4-3b4aac39954d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:58.369175 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7b018a3a-42cf-4455-b9f4-3b4aac39954d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:58.369873 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7b018a3a-42cf-4455-b9f4-3b4aac39954d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:58.370338 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7b018a3a-42cf-4455-b9f4-3b4aac39954d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:58.370775 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7b018a3a-42cf-4455-b9f4-3b4aac39954d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:58.403037 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7b018a3a-42cf-4455-b9f4-3b4aac39954d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:58.403639 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7b018a3a-42cf-4455-b9f4-3b4aac39954d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:58.404117 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7b018a3a-42cf-4455-b9f4-3b4aac39954d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:58.404566 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.objects.instance [None req-7b018a3a-42cf-4455-b9f4-3b4aac39954d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lazy-loading 'fault' on Instance uuid de0f1a98-9419-4e35-b8e0-520c7fc482fb {{(pid=120463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 12:28:58.444053 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-7b018a3a-42cf-4455-b9f4-3b4aac39954d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:28:58.452621 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-7b018a3a-42cf-4455-b9f4-3b4aac39954d tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 200 len: 1312 microversion: 2.1 time: 0.095371 Sep 21 12:28:58.453190 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 392/793] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:58 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:28:59.477007 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-2fc05da3-a255-4602-890b-d2de3fa05d4e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:59.477627 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-2fc05da3-a255-4602-890b-d2de3fa05d4e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: de0f1a98-9419-4e35-b8e0-520c7fc482fb] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:59.484219 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2fc05da3-a255-4602-890b-d2de3fa05d4e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:59.484700 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2fc05da3-a255-4602-890b-d2de3fa05d4e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:59.485139 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2fc05da3-a255-4602-890b-d2de3fa05d4e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:59.485827 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2fc05da3-a255-4602-890b-d2de3fa05d4e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:59.486285 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2fc05da3-a255-4602-890b-d2de3fa05d4e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:59.486713 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2fc05da3-a255-4602-890b-d2de3fa05d4e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:59.500411 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.wsgi [None req-2fc05da3-a255-4602-890b-d2de3fa05d4e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] HTTP exception thrown: Instance de0f1a98-9419-4e35-b8e0-520c7fc482fb could not be found. Sep 21 12:28:59.502103 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-2fc05da3-a255-4602-890b-d2de3fa05d4e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Request method failure captured: Sep 21 12:28:59.502103 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: request: GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb HTTP/1.1 Sep 21 12:28:59.502103 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept: application/json Sep 21 12:28:59.502103 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept-Encoding: identity Sep 21 12:28:59.502103 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Connection: close Sep 21 12:28:59.502103 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Length: 0 Sep 21 12:28:59.502103 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Type: application/json Sep 21 12:28:59.502103 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Host: 10.222.0.71 Sep 21 12:28:59.502103 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Openstack-System-Scope: None Sep 21 12:28:59.502103 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: User-Agent: python-urllib3/1.26.12 Sep 21 12:28:59.502103 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Auth-Token: gAAAAABjKwIu3mnwMp4ApNIfIkJUKxsVNJlj-i9y2ZniVDXL-EUHk78SFz38tXU5y8GhQ-eemD725G2hynLgc-_b-6YI8t1ZBLfru0cqJKYCMo5RetnJGUB4BU8XXayroqGJwhgW8Hog1xUJ-Zgaw42z7TLv76VdJCVDouWswH2FyTkqoFyyieY Sep 21 12:28:59.502103 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Id: None Sep 21 12:28:59.502103 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Name: None Sep 21 12:28:59.502103 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Identity-Status: Confirmed Sep 21 12:28:59.502103 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Is-Admin-Project: True Sep 21 12:28:59.502103 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Id: default Sep 21 12:28:59.502103 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Name: Default Sep 21 12:28:59.502103 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Id: d3bd02ae79fd4edb9886b1b4ef3d761a Sep 21 12:28:59.502103 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-914007599 Sep 21 12:28:59.502103 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Role: reader,member Sep 21 12:28:59.502103 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Roles: reader,member Sep 21 12:28:59.503596 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/d3bd02ae79fd4edb9886b1b4ef3d761a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/d3bd02ae79fd4edb9886b1b4ef3d761a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_d3bd02ae79fd4edb9886b1b4ef3d761a", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/d3bd02ae79fd4edb9886b1b4ef3d761a"}]}] Sep 21 12:28:59.503596 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant: tempest-ServerRescueNegativeTestJSON-914007599 Sep 21 12:28:59.503596 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Id: d3bd02ae79fd4edb9886b1b4ef3d761a Sep 21 12:28:59.503596 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-914007599 Sep 21 12:28:59.503596 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User: tempest-ServerRescueNegativeTestJSON-914007599-project Sep 21 12:28:59.503596 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Id: default Sep 21 12:28:59.503596 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Name: Default Sep 21 12:28:59.503596 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Id: 0fb9105e474a4a29904722b1e33d0155 Sep 21 12:28:59.503596 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Name: tempest-ServerRescueNegativeTestJSON-914007599-project Sep 21 12:28:59.503596 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: method: > Sep 21 12:28:59.503596 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: exception: Instance de0f1a98-9419-4e35-b8e0-520c7fc482fb could not be found. Sep 21 12:28:59.503596 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: action_args: {'id': 'de0f1a98-9419-4e35-b8e0-520c7fc482fb'} Sep 21 12:28:59.504412 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:28:59.504412 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:28:59.504412 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:28:59.504412 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:28:59.504412 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:28:59.504412 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:28:59.504412 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:28:59.504412 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:28:59.504412 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:28:59.504412 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:28:59.504412 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de0f1a98-9419-4e35-b8e0-520c7fc482fb could not be found. Sep 21 12:28:59.504412 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:28:59.504412 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:28:59.504412 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:28:59.504412 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:28:59.504412 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:28:59.504412 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:28:59.504412 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:28:59.504412 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:28:59.504412 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:28:59.505782 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:28:59.505782 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 12:28:59.505782 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 12:28:59.505782 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:28:59.505782 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:28:59.505782 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:28:59.505782 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:28:59.505782 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de0f1a98-9419-4e35-b8e0-520c7fc482fb could not be found. Sep 21 12:28:59.505782 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:28:59.505782 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:28:59.505782 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:28:59.505782 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:28:59.505782 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:28:59.505782 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:28:59.505782 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:28:59.505782 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:28:59.505782 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de0f1a98-9419-4e35-b8e0-520c7fc482fb could not be found. Sep 21 12:28:59.505782 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:28:59.507096 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-2fc05da3-a255-4602-890b-d2de3fa05d4e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Returning 404 to user: Instance de0f1a98-9419-4e35-b8e0-520c7fc482fb could not be found. {{(pid=120462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:28:59.507096 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-2fc05da3-a255-4602-890b-d2de3fa05d4e tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb" status: 404 len: 111 microversion: 2.1 time: 0.031320 Sep 21 12:28:59.507096 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 402/794] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:59 2022] GET /compute/v2.1/servers/de0f1a98-9419-4e35-b8e0-520c7fc482fb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:28:59.512794 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-b9405d68-af1e-455b-9dbd-6fc69f1d10ea tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:59.513275 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-b9405d68-af1e-455b-9dbd-6fc69f1d10ea tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:59.519499 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b9405d68-af1e-455b-9dbd-6fc69f1d10ea tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:59.520013 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b9405d68-af1e-455b-9dbd-6fc69f1d10ea tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:59.520451 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b9405d68-af1e-455b-9dbd-6fc69f1d10ea tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:59.521135 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b9405d68-af1e-455b-9dbd-6fc69f1d10ea tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:59.521668 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b9405d68-af1e-455b-9dbd-6fc69f1d10ea tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:59.522089 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b9405d68-af1e-455b-9dbd-6fc69f1d10ea tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:59.548949 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-b9405d68-af1e-455b-9dbd-6fc69f1d10ea tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Going to try to terminate instance {{(pid=120463) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 12:28:59.622843 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-b9405d68-af1e-455b-9dbd-6fc69f1d10ea tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "DELETE /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 204 len: 0 microversion: 2.1 time: 0.113842 Sep 21 12:28:59.626614 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 393/795] 10.222.0.71 () {58 vars in 1239 bytes} [Wed Sep 21 12:28:59 2022] DELETE /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 21 12:28:59.632550 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-9a213a69-6ce0-40ab-b9ee-59440954b818 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:28:59.633169 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-9a213a69-6ce0-40ab-b9ee-59440954b818 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:28:59.639022 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9a213a69-6ce0-40ab-b9ee-59440954b818 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:59.639532 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9a213a69-6ce0-40ab-b9ee-59440954b818 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:59.640024 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9a213a69-6ce0-40ab-b9ee-59440954b818 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:59.640705 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9a213a69-6ce0-40ab-b9ee-59440954b818 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:28:59.641161 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9a213a69-6ce0-40ab-b9ee-59440954b818 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:28:59.641585 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9a213a69-6ce0-40ab-b9ee-59440954b818 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:28:59.778998 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-9a213a69-6ce0-40ab-b9ee-59440954b818 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:28:59.786585 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-9a213a69-6ce0-40ab-b9ee-59440954b818 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1523 microversion: 2.1 time: 0.158515 Sep 21 12:28:59.787173 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 403/796] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:28:59 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:29:00.185897 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-02609c24-413e-4558-a0ce-1c2fd27b709d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-925080453", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-250182085", "security_groups": [{"name": "tempest-secgroup-smoke-448455005"}], "networks": [{"uuid": "f443e4f9-b2cf-41c0-aace-fc1b385c5aad"}], "block_device_mapping_v2": [{"uuid": "b1ebec96-d5a7-4c23-b28c-19f6e8c6c124", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:29:00.304870 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.network.neutron [None req-02609c24-413e-4558-a0ce-1c2fd27b709d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] validate_networks() for [('f443e4f9-b2cf-41c0-aace-fc1b385c5aad', None, None, None, None, None)] {{(pid=120463) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 12:29:00.779871 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-02609c24-413e-4558-a0ce-1c2fd27b709d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Flavor limits 0:0:0 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 12:29:00.780457 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-02609c24-413e-4558-a0ce-1c2fd27b709d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Image limits 0:0:0 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 12:29:00.780774 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-02609c24-413e-4558-a0ce-1c2fd27b709d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Flavor pref 0:0:0 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 12:29:00.781189 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-02609c24-413e-4558-a0ce-1c2fd27b709d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Image pref 0:0:0 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 12:29:00.781614 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-02609c24-413e-4558-a0ce-1c2fd27b709d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 12:29:00.790298 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-02609c24-413e-4558-a0ce-1c2fd27b709d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:00.790785 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-02609c24-413e-4558-a0ce-1c2fd27b709d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:00.791227 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-02609c24-413e-4558-a0ce-1c2fd27b709d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:00.792012 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-02609c24-413e-4558-a0ce-1c2fd27b709d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:00.792479 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-02609c24-413e-4558-a0ce-1c2fd27b709d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:00.792913 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-02609c24-413e-4558-a0ce-1c2fd27b709d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:00.810740 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-ea2fb96c-ca5e-4fdd-862e-89eec1e0b7ad tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:00.811419 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.quota [None req-02609c24-413e-4558-a0ce-1c2fd27b709d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Getting quotas for project 95515a2858124583ac138aa6350e4bc3. Resources: {'instances', 'ram', 'cores'} {{(pid=120463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 12:29:00.811672 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-ea2fb96c-ca5e-4fdd-862e-89eec1e0b7ad tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:00.815548 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.quota [None req-02609c24-413e-4558-a0ce-1c2fd27b709d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Getting quotas for user 94c4cdfb0f264398a7d3b155a9523b11 and project 95515a2858124583ac138aa6350e4bc3. Resources: {'instances', 'ram', 'cores'} {{(pid=120463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 12:29:00.818244 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ea2fb96c-ca5e-4fdd-862e-89eec1e0b7ad tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:00.818811 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ea2fb96c-ca5e-4fdd-862e-89eec1e0b7ad tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:00.819351 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ea2fb96c-ca5e-4fdd-862e-89eec1e0b7ad tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:00.820166 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ea2fb96c-ca5e-4fdd-862e-89eec1e0b7ad tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:00.820634 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ea2fb96c-ca5e-4fdd-862e-89eec1e0b7ad tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:00.821064 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ea2fb96c-ca5e-4fdd-862e-89eec1e0b7ad tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:00.877136 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-02609c24-413e-4558-a0ce-1c2fd27b709d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Going to run 1 instances... {{(pid=120463) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 12:29:00.879454 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-02609c24-413e-4558-a0ce-1c2fd27b709d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b1ebec96-d5a7-4c23-b28c-19f6e8c6c124',volume_size=None,volume_type=None)] {{(pid=120463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 12:29:00.957540 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-ea2fb96c-ca5e-4fdd-862e-89eec1e0b7ad tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:00.965930 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-ea2fb96c-ca5e-4fdd-862e-89eec1e0b7ad tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1523 microversion: 2.1 time: 0.159759 Sep 21 12:29:00.966511 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 404/797] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:29:00 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:29:01.014790 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-02609c24-413e-4558-a0ce-1c2fd27b709d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.832993 Sep 21 12:29:01.015479 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 394/798] 10.222.0.71 () {60 vars in 1147 bytes} [Wed Sep 21 12:29:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 21 12:29:01.026591 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-2601955a-8fd9-4554-93af-02a9df2c2519 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:01.027207 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-2601955a-8fd9-4554-93af-02a9df2c2519 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:01.082500 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-2601955a-8fd9-4554-93af-02a9df2c2519 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:01.089387 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-2601955a-8fd9-4554-93af-02a9df2c2519 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1087 microversion: 2.1 time: 0.066629 Sep 21 12:29:01.090487 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 405/799] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:29:01 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1087 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:29:01.990048 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-8f32e71e-555a-4277-9b46-83ecc4d2d978 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:01.990582 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-8f32e71e-555a-4277-9b46-83ecc4d2d978 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:01.998150 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8f32e71e-555a-4277-9b46-83ecc4d2d978 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:01.998665 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8f32e71e-555a-4277-9b46-83ecc4d2d978 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:01.999109 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8f32e71e-555a-4277-9b46-83ecc4d2d978 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:01.999833 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8f32e71e-555a-4277-9b46-83ecc4d2d978 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:02.000295 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8f32e71e-555a-4277-9b46-83ecc4d2d978 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:02.000725 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8f32e71e-555a-4277-9b46-83ecc4d2d978 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:02.112369 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-38e08942-82e4-4f25-9b2f-0fcab5eccd04 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:02.113074 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-38e08942-82e4-4f25-9b2f-0fcab5eccd04 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:02.120553 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-38e08942-82e4-4f25-9b2f-0fcab5eccd04 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:02.121190 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-38e08942-82e4-4f25-9b2f-0fcab5eccd04 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:02.121711 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-38e08942-82e4-4f25-9b2f-0fcab5eccd04 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:02.123019 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-38e08942-82e4-4f25-9b2f-0fcab5eccd04 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:02.123612 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-38e08942-82e4-4f25-9b2f-0fcab5eccd04 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:02.124140 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-38e08942-82e4-4f25-9b2f-0fcab5eccd04 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:02.143144 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-8f32e71e-555a-4277-9b46-83ecc4d2d978 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:02.153213 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-8f32e71e-555a-4277-9b46-83ecc4d2d978 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1523 microversion: 2.1 time: 0.167194 Sep 21 12:29:02.154077 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 395/800] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:29:01 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:29:02.189084 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-38e08942-82e4-4f25-9b2f-0fcab5eccd04 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:02.196801 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-38e08942-82e4-4f25-9b2f-0fcab5eccd04 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1185 microversion: 2.1 time: 0.088403 Sep 21 12:29:02.197369 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 406/801] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:29:02 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:29:03.177065 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-ca29f015-aac7-4287-8a5b-83ff91978177 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:03.177820 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-ca29f015-aac7-4287-8a5b-83ff91978177 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:03.184671 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ca29f015-aac7-4287-8a5b-83ff91978177 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:03.185251 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ca29f015-aac7-4287-8a5b-83ff91978177 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:03.185740 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ca29f015-aac7-4287-8a5b-83ff91978177 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:03.186504 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ca29f015-aac7-4287-8a5b-83ff91978177 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:03.187014 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ca29f015-aac7-4287-8a5b-83ff91978177 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:03.187477 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ca29f015-aac7-4287-8a5b-83ff91978177 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:03.221377 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-13941862-7df3-4b82-ae33-4cd34adafcd3 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:03.222311 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-13941862-7df3-4b82-ae33-4cd34adafcd3 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:03.229833 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-13941862-7df3-4b82-ae33-4cd34adafcd3 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:03.230683 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-13941862-7df3-4b82-ae33-4cd34adafcd3 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:03.231207 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-13941862-7df3-4b82-ae33-4cd34adafcd3 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:03.231950 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-13941862-7df3-4b82-ae33-4cd34adafcd3 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:03.232414 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-13941862-7df3-4b82-ae33-4cd34adafcd3 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:03.232844 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-13941862-7df3-4b82-ae33-4cd34adafcd3 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:03.324226 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-ca29f015-aac7-4287-8a5b-83ff91978177 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb9105e474a4a29904722b1e33d0155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bd02ae79fd4edb9886b1b4ef3d761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:03.334585 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-13941862-7df3-4b82-ae33-4cd34adafcd3 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:03.335688 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-ca29f015-aac7-4287-8a5b-83ff91978177 tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 200 len: 1523 microversion: 2.1 time: 0.162459 Sep 21 12:29:03.348739 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-13941862-7df3-4b82-ae33-4cd34adafcd3 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1203 microversion: 2.1 time: 0.132078 Sep 21 12:29:03.349805 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 407/802] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:29:03 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1203 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:29:03.363702 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 396/803] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:29:03 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:29:03.480902 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-41ee2ed0-dd1c-4145-9651-f4a12c429ebc req-6104e483-c9b6-4597-94ba-53010c000f97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5560ddde-2668-4e31-bbbf-b94d7485df5a", "name": "network-vif-deleted", "tag": "3fb9b2d0-df9a-421a-b7da-b2bbf6f67639"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:29:03.494996 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-41ee2ed0-dd1c-4145-9651-f4a12c429ebc req-6104e483-c9b6-4597-94ba-53010c000f97 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:03.495875 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-41ee2ed0-dd1c-4145-9651-f4a12c429ebc req-6104e483-c9b6-4597-94ba-53010c000f97 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:03.496518 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-41ee2ed0-dd1c-4145-9651-f4a12c429ebc req-6104e483-c9b6-4597-94ba-53010c000f97 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:03.528570 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-41ee2ed0-dd1c-4145-9651-f4a12c429ebc req-6104e483-c9b6-4597-94ba-53010c000f97 service nova] Creating event network-vif-deleted:3fb9b2d0-df9a-421a-b7da-b2bbf6f67639 for instance 5560ddde-2668-4e31-bbbf-b94d7485df5a on hv-cinder-85867 Sep 21 12:29:03.535220 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-41ee2ed0-dd1c-4145-9651-f4a12c429ebc req-6104e483-c9b6-4597-94ba-53010c000f97 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060462 Sep 21 12:29:03.536934 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 397/804] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 12:29:04.372256 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-717f2c69-56b4-4e33-bb85-1fe2309408fa tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:04.373336 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-717f2c69-56b4-4e33-bb85-1fe2309408fa tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] [instance: 5560ddde-2668-4e31-bbbf-b94d7485df5a] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:04.380035 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-717f2c69-56b4-4e33-bb85-1fe2309408fa tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:04.380522 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-717f2c69-56b4-4e33-bb85-1fe2309408fa tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:04.380961 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-717f2c69-56b4-4e33-bb85-1fe2309408fa tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:04.381126 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-c0bbbf96-682a-4180-b4ab-d217e4f12d0d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:04.381646 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-717f2c69-56b4-4e33-bb85-1fe2309408fa tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:04.382096 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-717f2c69-56b4-4e33-bb85-1fe2309408fa tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:04.382518 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-717f2c69-56b4-4e33-bb85-1fe2309408fa tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:04.382631 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-c0bbbf96-682a-4180-b4ab-d217e4f12d0d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:04.386883 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:29:04.390331 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0bbbf96-682a-4180-b4ab-d217e4f12d0d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:04.390836 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0bbbf96-682a-4180-b4ab-d217e4f12d0d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:04.391282 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0bbbf96-682a-4180-b4ab-d217e4f12d0d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:04.392177 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0bbbf96-682a-4180-b4ab-d217e4f12d0d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:04.392650 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0bbbf96-682a-4180-b4ab-d217e4f12d0d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:04.393083 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0bbbf96-682a-4180-b4ab-d217e4f12d0d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:04.399302 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.wsgi [None req-717f2c69-56b4-4e33-bb85-1fe2309408fa tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] HTTP exception thrown: Instance 5560ddde-2668-4e31-bbbf-b94d7485df5a could not be found. Sep 21 12:29:04.401098 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-717f2c69-56b4-4e33-bb85-1fe2309408fa tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Request method failure captured: Sep 21 12:29:04.401098 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: request: GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a HTTP/1.1 Sep 21 12:29:04.401098 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept: application/json Sep 21 12:29:04.401098 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept-Encoding: identity Sep 21 12:29:04.401098 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Connection: close Sep 21 12:29:04.401098 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Length: 0 Sep 21 12:29:04.401098 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Type: application/json Sep 21 12:29:04.401098 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Host: 10.222.0.71 Sep 21 12:29:04.401098 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Openstack-System-Scope: None Sep 21 12:29:04.401098 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: User-Agent: python-urllib3/1.26.12 Sep 21 12:29:04.401098 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Auth-Token: gAAAAABjKwIu3mnwMp4ApNIfIkJUKxsVNJlj-i9y2ZniVDXL-EUHk78SFz38tXU5y8GhQ-eemD725G2hynLgc-_b-6YI8t1ZBLfru0cqJKYCMo5RetnJGUB4BU8XXayroqGJwhgW8Hog1xUJ-Zgaw42z7TLv76VdJCVDouWswH2FyTkqoFyyieY Sep 21 12:29:04.401098 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Id: None Sep 21 12:29:04.401098 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Name: None Sep 21 12:29:04.401098 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Identity-Status: Confirmed Sep 21 12:29:04.401098 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Is-Admin-Project: True Sep 21 12:29:04.401098 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Id: default Sep 21 12:29:04.401098 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Name: Default Sep 21 12:29:04.401098 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Id: d3bd02ae79fd4edb9886b1b4ef3d761a Sep 21 12:29:04.401098 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-914007599 Sep 21 12:29:04.401098 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Role: reader,member Sep 21 12:29:04.401098 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Roles: reader,member Sep 21 12:29:04.402494 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/d3bd02ae79fd4edb9886b1b4ef3d761a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/d3bd02ae79fd4edb9886b1b4ef3d761a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_d3bd02ae79fd4edb9886b1b4ef3d761a", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/d3bd02ae79fd4edb9886b1b4ef3d761a"}]}] Sep 21 12:29:04.402494 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant: tempest-ServerRescueNegativeTestJSON-914007599 Sep 21 12:29:04.402494 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Id: d3bd02ae79fd4edb9886b1b4ef3d761a Sep 21 12:29:04.402494 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-914007599 Sep 21 12:29:04.402494 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User: tempest-ServerRescueNegativeTestJSON-914007599-project Sep 21 12:29:04.402494 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Id: default Sep 21 12:29:04.402494 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Name: Default Sep 21 12:29:04.402494 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Id: 0fb9105e474a4a29904722b1e33d0155 Sep 21 12:29:04.402494 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Name: tempest-ServerRescueNegativeTestJSON-914007599-project Sep 21 12:29:04.402494 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: method: > Sep 21 12:29:04.402494 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: exception: Instance 5560ddde-2668-4e31-bbbf-b94d7485df5a could not be found. Sep 21 12:29:04.402494 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: action_args: {'id': '5560ddde-2668-4e31-bbbf-b94d7485df5a'} Sep 21 12:29:04.403267 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:29:04.403267 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:29:04.403267 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:29:04.403267 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:29:04.403267 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:29:04.403267 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:29:04.403267 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:29:04.403267 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:29:04.403267 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:29:04.403267 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:29:04.403267 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5560ddde-2668-4e31-bbbf-b94d7485df5a could not be found. Sep 21 12:29:04.403267 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:29:04.403267 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:29:04.403267 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:29:04.403267 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:29:04.403267 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:29:04.403267 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:29:04.403267 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:29:04.403267 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:29:04.403267 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:29:04.404562 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:29:04.404562 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 12:29:04.404562 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 12:29:04.404562 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:29:04.404562 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:29:04.404562 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:29:04.404562 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:29:04.404562 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5560ddde-2668-4e31-bbbf-b94d7485df5a could not be found. Sep 21 12:29:04.404562 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:29:04.404562 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:29:04.404562 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:29:04.404562 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:29:04.404562 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:29:04.404562 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:29:04.404562 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:29:04.404562 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:29:04.404562 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5560ddde-2668-4e31-bbbf-b94d7485df5a could not be found. Sep 21 12:29:04.404562 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:29:04.405679 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-717f2c69-56b4-4e33-bb85-1fe2309408fa tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] Returning 404 to user: Instance 5560ddde-2668-4e31-bbbf-b94d7485df5a could not be found. {{(pid=120462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:29:04.405679 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-717f2c69-56b4-4e33-bb85-1fe2309408fa tempest-ServerRescueNegativeTestJSON-914007599 tempest-ServerRescueNegativeTestJSON-914007599-project] 10.222.0.71 "GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a" status: 404 len: 111 microversion: 2.1 time: 0.034283 Sep 21 12:29:04.405679 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 408/805] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:29:04 2022] GET /compute/v2.1/servers/5560ddde-2668-4e31-bbbf-b94d7485df5a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:29:04.551222 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-c0bbbf96-682a-4180-b4ab-d217e4f12d0d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:04.561066 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-c0bbbf96-682a-4180-b4ab-d217e4f12d0d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1258 microversion: 2.1 time: 0.184067 Sep 21 12:29:04.561653 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 398/806] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:29:04 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1258 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:29:05.553469 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-6bf6a30c-d28e-49ae-bfe8-640f81ee7ad5 req-b871ab62-7e60-4a76-9c32-aae43455a959 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66e9cb90-c71a-420a-b647-991844d5c17c", "tag": "15af239b-da86-43fe-81e4-6adb2158f5c6"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:29:05.564914 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-6bf6a30c-d28e-49ae-bfe8-640f81ee7ad5 req-b871ab62-7e60-4a76-9c32-aae43455a959 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:05.565760 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-6bf6a30c-d28e-49ae-bfe8-640f81ee7ad5 req-b871ab62-7e60-4a76-9c32-aae43455a959 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:05.566300 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-6bf6a30c-d28e-49ae-bfe8-640f81ee7ad5 req-b871ab62-7e60-4a76-9c32-aae43455a959 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:05.584978 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-601f143e-ceee-4fac-8252-3ec50237aa06 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:05.585703 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-601f143e-ceee-4fac-8252-3ec50237aa06 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:05.589406 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:29:05.589925 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-6bf6a30c-d28e-49ae-bfe8-640f81ee7ad5 req-b871ab62-7e60-4a76-9c32-aae43455a959 service nova] Creating event network-changed:15af239b-da86-43fe-81e4-6adb2158f5c6 for instance 66e9cb90-c71a-420a-b647-991844d5c17c on hv-cinder-85867 Sep 21 12:29:05.594216 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-601f143e-ceee-4fac-8252-3ec50237aa06 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:05.598290 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-601f143e-ceee-4fac-8252-3ec50237aa06 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:05.598862 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-601f143e-ceee-4fac-8252-3ec50237aa06 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:05.599774 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-6bf6a30c-d28e-49ae-bfe8-640f81ee7ad5 req-b871ab62-7e60-4a76-9c32-aae43455a959 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052272 Sep 21 12:29:05.600244 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-601f143e-ceee-4fac-8252-3ec50237aa06 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:05.600827 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-601f143e-ceee-4fac-8252-3ec50237aa06 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:05.601508 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-601f143e-ceee-4fac-8252-3ec50237aa06 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:05.603964 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 409/807] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 12:29:05.612180 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:29:05.833784 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-601f143e-ceee-4fac-8252-3ec50237aa06 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:05.842187 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-601f143e-ceee-4fac-8252-3ec50237aa06 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1258 microversion: 2.1 time: 0.261118 Sep 21 12:29:05.842771 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 399/808] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:29:05 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1258 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:29:06.866295 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-db9d67a7-86d9-4a88-a86b-d80c4b21341c tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:06.866997 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-db9d67a7-86d9-4a88-a86b-d80c4b21341c tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:06.873425 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-db9d67a7-86d9-4a88-a86b-d80c4b21341c tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:06.873921 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-db9d67a7-86d9-4a88-a86b-d80c4b21341c tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:06.874332 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-db9d67a7-86d9-4a88-a86b-d80c4b21341c tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:06.875153 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-db9d67a7-86d9-4a88-a86b-d80c4b21341c tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:06.875608 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-db9d67a7-86d9-4a88-a86b-d80c4b21341c tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:06.876091 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-db9d67a7-86d9-4a88-a86b-d80c4b21341c tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:07.012289 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-db9d67a7-86d9-4a88-a86b-d80c4b21341c tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:07.021696 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-db9d67a7-86d9-4a88-a86b-d80c4b21341c tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1258 microversion: 2.1 time: 0.160060 Sep 21 12:29:07.022463 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 410/809] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:29:06 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:29:07.242864 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-d7b0304c-1509-431f-a7da-024b95a36a64 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:07.243495 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-d7b0304c-1509-431f-a7da-024b95a36a64 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:07.252824 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d7b0304c-1509-431f-a7da-024b95a36a64 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:07.253328 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d7b0304c-1509-431f-a7da-024b95a36a64 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:07.253782 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d7b0304c-1509-431f-a7da-024b95a36a64 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:07.254642 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d7b0304c-1509-431f-a7da-024b95a36a64 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:07.255283 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d7b0304c-1509-431f-a7da-024b95a36a64 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:07.255917 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d7b0304c-1509-431f-a7da-024b95a36a64 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:07.283734 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-d7b0304c-1509-431f-a7da-024b95a36a64 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b/ips" status: 200 len: 152 microversion: 2.20 time: 0.050637 Sep 21 12:29:07.284902 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 400/810] 10.222.0.71 () {60 vars in 1289 bytes} [Wed Sep 21 12:29:07 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b/ips => generated 152 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 21 12:29:08.045041 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-a173e35e-8e16-413c-ba8e-ad6fc568dcc2 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:08.045661 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-a173e35e-8e16-413c-ba8e-ad6fc568dcc2 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:08.052163 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a173e35e-8e16-413c-ba8e-ad6fc568dcc2 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:08.052657 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a173e35e-8e16-413c-ba8e-ad6fc568dcc2 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:08.053124 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a173e35e-8e16-413c-ba8e-ad6fc568dcc2 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:08.053815 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a173e35e-8e16-413c-ba8e-ad6fc568dcc2 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:08.054273 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a173e35e-8e16-413c-ba8e-ad6fc568dcc2 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:08.054702 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a173e35e-8e16-413c-ba8e-ad6fc568dcc2 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:08.198062 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-a173e35e-8e16-413c-ba8e-ad6fc568dcc2 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:08.206217 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-a173e35e-8e16-413c-ba8e-ad6fc568dcc2 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1258 microversion: 2.1 time: 0.165697 Sep 21 12:29:08.207358 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 411/811] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:29:08 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:29:09.156725 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-1ed28aea-bed1-49d8-b355-fc4f8e8cf0b6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:29:09.157268 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-1ed28aea-bed1-49d8-b355-fc4f8e8cf0b6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:09.163820 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1ed28aea-bed1-49d8-b355-fc4f8e8cf0b6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:09.164312 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1ed28aea-bed1-49d8-b355-fc4f8e8cf0b6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:09.164755 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1ed28aea-bed1-49d8-b355-fc4f8e8cf0b6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:09.165451 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1ed28aea-bed1-49d8-b355-fc4f8e8cf0b6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:09.165911 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1ed28aea-bed1-49d8-b355-fc4f8e8cf0b6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:09.166344 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1ed28aea-bed1-49d8-b355-fc4f8e8cf0b6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:09.190058 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.objects.instance [None req-1ed28aea-bed1-49d8-b355-fc4f8e8cf0b6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lazy-loading 'flavor' on Instance uuid dc34c677-0e22-4734-95ed-4a6834d9dc7b {{(pid=120463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 12:29:09.229761 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-33d44248-a609-48c0-91a1-5113234256ad tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:09.230374 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-33d44248-a609-48c0-91a1-5113234256ad tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:09.237136 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-33d44248-a609-48c0-91a1-5113234256ad tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:09.237991 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-33d44248-a609-48c0-91a1-5113234256ad tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:09.238902 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-33d44248-a609-48c0-91a1-5113234256ad tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:09.239967 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-33d44248-a609-48c0-91a1-5113234256ad tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:09.240632 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-33d44248-a609-48c0-91a1-5113234256ad tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:09.241064 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-33d44248-a609-48c0-91a1-5113234256ad tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:09.389156 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-33d44248-a609-48c0-91a1-5113234256ad tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:09.391882 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-1ed28aea-bed1-49d8-b355-fc4f8e8cf0b6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "POST /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b/action" status: 202 len: 0 microversion: 2.20 time: 0.239003 Sep 21 12:29:09.392489 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 401/812] 10.222.0.71 () {62 vars in 1319 bytes} [Wed Sep 21 12:29:09 2022] POST /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 21 12:29:09.399641 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-33d44248-a609-48c0-91a1-5113234256ad tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1258 microversion: 2.1 time: 0.173690 Sep 21 12:29:09.408304 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-e4592237-5def-44c8-81e7-bb9dc2330c8b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:09.408304 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-e4592237-5def-44c8-81e7-bb9dc2330c8b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:09.409434 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 412/813] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:29:09 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1258 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:29:09.411191 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e4592237-5def-44c8-81e7-bb9dc2330c8b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:09.411691 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e4592237-5def-44c8-81e7-bb9dc2330c8b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:09.412246 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e4592237-5def-44c8-81e7-bb9dc2330c8b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:09.412976 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e4592237-5def-44c8-81e7-bb9dc2330c8b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:09.413616 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e4592237-5def-44c8-81e7-bb9dc2330c8b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:09.414256 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e4592237-5def-44c8-81e7-bb9dc2330c8b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:09.553390 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-e4592237-5def-44c8-81e7-bb9dc2330c8b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:09.561538 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-e4592237-5def-44c8-81e7-bb9dc2330c8b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:09.563042 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-e4592237-5def-44c8-81e7-bb9dc2330c8b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:09.564263 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-e4592237-5def-44c8-81e7-bb9dc2330c8b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1722 microversion: 2.20 time: 0.166647 Sep 21 12:29:09.564836 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 402/814] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:09 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:29:10.426147 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-9f8bb4a6-0f60-4cb4-abfd-f92b811a937e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:10.426759 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-9f8bb4a6-0f60-4cb4-abfd-f92b811a937e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:10.437280 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9f8bb4a6-0f60-4cb4-abfd-f92b811a937e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:10.437280 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9f8bb4a6-0f60-4cb4-abfd-f92b811a937e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:10.437280 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9f8bb4a6-0f60-4cb4-abfd-f92b811a937e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:10.437280 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9f8bb4a6-0f60-4cb4-abfd-f92b811a937e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:10.437606 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9f8bb4a6-0f60-4cb4-abfd-f92b811a937e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:10.437606 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9f8bb4a6-0f60-4cb4-abfd-f92b811a937e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:10.571185 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-9f8bb4a6-0f60-4cb4-abfd-f92b811a937e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:10.579633 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-9f8bb4a6-0f60-4cb4-abfd-f92b811a937e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1258 microversion: 2.1 time: 0.157058 Sep 21 12:29:10.592119 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 413/815] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:29:10 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:29:10.592343 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-79a2e767-d877-4dd0-ab2e-9741fb11eb60 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:10.593810 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-79a2e767-d877-4dd0-ab2e-9741fb11eb60 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:10.601569 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-79a2e767-d877-4dd0-ab2e-9741fb11eb60 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:10.602332 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-79a2e767-d877-4dd0-ab2e-9741fb11eb60 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:10.602971 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-79a2e767-d877-4dd0-ab2e-9741fb11eb60 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:10.604002 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-79a2e767-d877-4dd0-ab2e-9741fb11eb60 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:10.604568 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-79a2e767-d877-4dd0-ab2e-9741fb11eb60 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:10.605178 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-79a2e767-d877-4dd0-ab2e-9741fb11eb60 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:10.745467 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-79a2e767-d877-4dd0-ab2e-9741fb11eb60 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:10.754821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-79a2e767-d877-4dd0-ab2e-9741fb11eb60 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:10.756505 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-79a2e767-d877-4dd0-ab2e-9741fb11eb60 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:10.757901 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-79a2e767-d877-4dd0-ab2e-9741fb11eb60 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1722 microversion: 2.20 time: 0.170642 Sep 21 12:29:10.758485 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 403/816] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:10 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:29:11.603652 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-e80d2164-c921-4e3b-8499-6f88c3db7eaa tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:11.604953 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-e80d2164-c921-4e3b-8499-6f88c3db7eaa tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:11.607163 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell0:SELECT=2 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:29:11.613199 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e80d2164-c921-4e3b-8499-6f88c3db7eaa tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:11.613980 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e80d2164-c921-4e3b-8499-6f88c3db7eaa tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:11.614423 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e80d2164-c921-4e3b-8499-6f88c3db7eaa tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:11.615133 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e80d2164-c921-4e3b-8499-6f88c3db7eaa tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:11.615588 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e80d2164-c921-4e3b-8499-6f88c3db7eaa tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:11.616049 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e80d2164-c921-4e3b-8499-6f88c3db7eaa tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:11.763487 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-e80d2164-c921-4e3b-8499-6f88c3db7eaa tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:11.773216 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-e80d2164-c921-4e3b-8499-6f88c3db7eaa tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1258 microversion: 2.1 time: 0.174222 Sep 21 12:29:11.773799 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 414/817] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:29:11 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1258 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:29:11.794402 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-14a20640-6625-4f9a-a6f1-7e2b92dc201a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:11.795709 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-14a20640-6625-4f9a-a6f1-7e2b92dc201a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:11.798969 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell0:SELECT=2 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:29:11.799644 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell0:SELECT=6 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:29:11.804806 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-14a20640-6625-4f9a-a6f1-7e2b92dc201a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:11.805298 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-14a20640-6625-4f9a-a6f1-7e2b92dc201a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:11.805733 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-14a20640-6625-4f9a-a6f1-7e2b92dc201a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:11.806551 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-14a20640-6625-4f9a-a6f1-7e2b92dc201a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:11.807007 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-14a20640-6625-4f9a-a6f1-7e2b92dc201a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:11.807433 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-14a20640-6625-4f9a-a6f1-7e2b92dc201a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:11.955641 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-14a20640-6625-4f9a-a6f1-7e2b92dc201a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:11.963882 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-14a20640-6625-4f9a-a6f1-7e2b92dc201a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:11.965366 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-14a20640-6625-4f9a-a6f1-7e2b92dc201a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:11.966554 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-14a20640-6625-4f9a-a6f1-7e2b92dc201a tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1722 microversion: 2.20 time: 0.177442 Sep 21 12:29:11.967124 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 404/818] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:11 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:29:12.797398 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-b315f9b9-37f8-4f59-9e53-f683882ea5f3 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:12.798065 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-b315f9b9-37f8-4f59-9e53-f683882ea5f3 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:12.800417 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:29:12.805812 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b315f9b9-37f8-4f59-9e53-f683882ea5f3 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:12.806231 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b315f9b9-37f8-4f59-9e53-f683882ea5f3 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:12.806671 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b315f9b9-37f8-4f59-9e53-f683882ea5f3 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:12.807386 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b315f9b9-37f8-4f59-9e53-f683882ea5f3 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:12.807866 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b315f9b9-37f8-4f59-9e53-f683882ea5f3 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:12.808296 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b315f9b9-37f8-4f59-9e53-f683882ea5f3 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:12.950890 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-b315f9b9-37f8-4f59-9e53-f683882ea5f3 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:12.958934 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-b315f9b9-37f8-4f59-9e53-f683882ea5f3 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1258 microversion: 2.1 time: 0.165488 Sep 21 12:29:12.959748 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 415/819] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:29:12 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:29:12.992753 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-7c90ae9c-79a0-4ffa-a282-16f6d1c5b5f5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:12.993562 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-7c90ae9c-79a0-4ffa-a282-16f6d1c5b5f5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:13.000690 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7c90ae9c-79a0-4ffa-a282-16f6d1c5b5f5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:13.001268 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7c90ae9c-79a0-4ffa-a282-16f6d1c5b5f5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:13.001777 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7c90ae9c-79a0-4ffa-a282-16f6d1c5b5f5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:13.002577 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7c90ae9c-79a0-4ffa-a282-16f6d1c5b5f5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:13.003117 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7c90ae9c-79a0-4ffa-a282-16f6d1c5b5f5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:13.003743 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7c90ae9c-79a0-4ffa-a282-16f6d1c5b5f5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:13.139344 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-7c90ae9c-79a0-4ffa-a282-16f6d1c5b5f5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:13.150951 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-7c90ae9c-79a0-4ffa-a282-16f6d1c5b5f5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:13.152533 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-7c90ae9c-79a0-4ffa-a282-16f6d1c5b5f5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:13.153876 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-7c90ae9c-79a0-4ffa-a282-16f6d1c5b5f5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1722 microversion: 2.20 time: 0.165323 Sep 21 12:29:13.154317 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 405/820] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:12 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:29:13.983305 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-638c19e7-4351-4748-ba75-917460ab09d8 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:13.983854 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-638c19e7-4351-4748-ba75-917460ab09d8 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:13.990645 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-638c19e7-4351-4748-ba75-917460ab09d8 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:13.991130 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-638c19e7-4351-4748-ba75-917460ab09d8 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:13.991600 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-638c19e7-4351-4748-ba75-917460ab09d8 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:13.992325 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-638c19e7-4351-4748-ba75-917460ab09d8 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:13.992785 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-638c19e7-4351-4748-ba75-917460ab09d8 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:13.993215 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-638c19e7-4351-4748-ba75-917460ab09d8 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:14.127589 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-638c19e7-4351-4748-ba75-917460ab09d8 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:14.135213 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-638c19e7-4351-4748-ba75-917460ab09d8 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1258 microversion: 2.1 time: 0.156543 Sep 21 12:29:14.135806 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 416/821] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:29:13 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:29:14.179060 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-6a170e27-9e15-4716-8468-63fea76f3039 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:14.179672 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-6a170e27-9e15-4716-8468-63fea76f3039 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:14.186102 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6a170e27-9e15-4716-8468-63fea76f3039 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:14.186592 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6a170e27-9e15-4716-8468-63fea76f3039 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:14.187052 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6a170e27-9e15-4716-8468-63fea76f3039 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:14.187731 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6a170e27-9e15-4716-8468-63fea76f3039 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:14.188227 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6a170e27-9e15-4716-8468-63fea76f3039 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:14.188662 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6a170e27-9e15-4716-8468-63fea76f3039 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:14.322117 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-6a170e27-9e15-4716-8468-63fea76f3039 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:14.331087 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-6a170e27-9e15-4716-8468-63fea76f3039 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:14.332582 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-6a170e27-9e15-4716-8468-63fea76f3039 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:14.334906 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-6a170e27-9e15-4716-8468-63fea76f3039 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1722 microversion: 2.20 time: 0.159850 Sep 21 12:29:14.335478 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 406/822] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:14 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:29:15.159307 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-fcd9e3c4-208b-4882-9cbc-5ff2b2b39f58 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:15.159972 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-fcd9e3c4-208b-4882-9cbc-5ff2b2b39f58 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:15.166848 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fcd9e3c4-208b-4882-9cbc-5ff2b2b39f58 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:15.167330 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fcd9e3c4-208b-4882-9cbc-5ff2b2b39f58 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:15.167786 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fcd9e3c4-208b-4882-9cbc-5ff2b2b39f58 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:15.168477 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fcd9e3c4-208b-4882-9cbc-5ff2b2b39f58 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:15.169462 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fcd9e3c4-208b-4882-9cbc-5ff2b2b39f58 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:15.169881 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fcd9e3c4-208b-4882-9cbc-5ff2b2b39f58 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:15.308284 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-fcd9e3c4-208b-4882-9cbc-5ff2b2b39f58 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:15.316130 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-fcd9e3c4-208b-4882-9cbc-5ff2b2b39f58 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1258 microversion: 2.1 time: 0.161000 Sep 21 12:29:15.316707 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 417/823] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:29:15 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:29:15.361348 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-8e986aca-da73-439c-988d-0b4d26f7ea23 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:15.362036 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-8e986aca-da73-439c-988d-0b4d26f7ea23 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:15.368423 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8e986aca-da73-439c-988d-0b4d26f7ea23 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:15.368911 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8e986aca-da73-439c-988d-0b4d26f7ea23 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:15.369354 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8e986aca-da73-439c-988d-0b4d26f7ea23 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:15.370088 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8e986aca-da73-439c-988d-0b4d26f7ea23 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:15.370511 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8e986aca-da73-439c-988d-0b4d26f7ea23 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:15.370944 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8e986aca-da73-439c-988d-0b4d26f7ea23 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:15.495902 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-8e986aca-da73-439c-988d-0b4d26f7ea23 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:15.504319 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-8e986aca-da73-439c-988d-0b4d26f7ea23 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:15.505826 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-8e986aca-da73-439c-988d-0b4d26f7ea23 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:15.507007 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-8e986aca-da73-439c-988d-0b4d26f7ea23 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1722 microversion: 2.20 time: 0.149591 Sep 21 12:29:15.507573 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 407/824] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:15 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:29:16.338796 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-afbcb0c1-cb3b-4e44-88e9-8de96b348ec9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:16.339472 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-afbcb0c1-cb3b-4e44-88e9-8de96b348ec9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:16.347021 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-afbcb0c1-cb3b-4e44-88e9-8de96b348ec9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:16.347885 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-afbcb0c1-cb3b-4e44-88e9-8de96b348ec9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:16.348641 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-afbcb0c1-cb3b-4e44-88e9-8de96b348ec9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:16.349624 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-afbcb0c1-cb3b-4e44-88e9-8de96b348ec9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:16.350279 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-afbcb0c1-cb3b-4e44-88e9-8de96b348ec9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:16.351047 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-afbcb0c1-cb3b-4e44-88e9-8de96b348ec9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:16.451476 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-ba81ff37-b277-42f2-8412-dfa971842335 req-49155c56-70c0-4cbb-89b5-1e0077e00ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66e9cb90-c71a-420a-b647-991844d5c17c", "name": "network-vif-plugged", "status": "completed", "tag": "15af239b-da86-43fe-81e4-6adb2158f5c6"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:29:16.462575 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-ba81ff37-b277-42f2-8412-dfa971842335 req-49155c56-70c0-4cbb-89b5-1e0077e00ec3 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:16.463280 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-ba81ff37-b277-42f2-8412-dfa971842335 req-49155c56-70c0-4cbb-89b5-1e0077e00ec3 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:16.463972 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-ba81ff37-b277-42f2-8412-dfa971842335 req-49155c56-70c0-4cbb-89b5-1e0077e00ec3 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:16.482049 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-ba81ff37-b277-42f2-8412-dfa971842335 req-49155c56-70c0-4cbb-89b5-1e0077e00ec3 service nova] Creating event network-vif-plugged:15af239b-da86-43fe-81e4-6adb2158f5c6 for instance 66e9cb90-c71a-420a-b647-991844d5c17c on hv-cinder-85867 Sep 21 12:29:16.489164 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-ba81ff37-b277-42f2-8412-dfa971842335 req-49155c56-70c0-4cbb-89b5-1e0077e00ec3 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041874 Sep 21 12:29:16.490746 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 408/825] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 12:29:16.498735 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-afbcb0c1-cb3b-4e44-88e9-8de96b348ec9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:16.507584 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-afbcb0c1-cb3b-4e44-88e9-8de96b348ec9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1258 microversion: 2.1 time: 0.172747 Sep 21 12:29:16.509051 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 418/826] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:29:16 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1258 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:29:16.533181 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-7fbefcec-0981-4fa6-992a-79c7f3c82de6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:16.534112 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-7fbefcec-0981-4fa6-992a-79c7f3c82de6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:16.541110 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7fbefcec-0981-4fa6-992a-79c7f3c82de6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:16.541605 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7fbefcec-0981-4fa6-992a-79c7f3c82de6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:16.542063 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7fbefcec-0981-4fa6-992a-79c7f3c82de6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:16.542748 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7fbefcec-0981-4fa6-992a-79c7f3c82de6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:16.543406 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7fbefcec-0981-4fa6-992a-79c7f3c82de6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:16.544376 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7fbefcec-0981-4fa6-992a-79c7f3c82de6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:16.691034 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-7fbefcec-0981-4fa6-992a-79c7f3c82de6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:16.700204 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-7fbefcec-0981-4fa6-992a-79c7f3c82de6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:16.701675 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-7fbefcec-0981-4fa6-992a-79c7f3c82de6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:16.702868 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-7fbefcec-0981-4fa6-992a-79c7f3c82de6 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1722 microversion: 2.20 time: 0.174106 Sep 21 12:29:16.703437 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 409/827] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:16 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:29:17.530572 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-fce07818-0900-4fe9-91d8-70884b1cef4f tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:17.531191 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-fce07818-0900-4fe9-91d8-70884b1cef4f tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:17.537611 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fce07818-0900-4fe9-91d8-70884b1cef4f tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:17.538380 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fce07818-0900-4fe9-91d8-70884b1cef4f tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:17.538753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fce07818-0900-4fe9-91d8-70884b1cef4f tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:17.539453 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fce07818-0900-4fe9-91d8-70884b1cef4f tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:17.539941 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fce07818-0900-4fe9-91d8-70884b1cef4f tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:17.540370 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fce07818-0900-4fe9-91d8-70884b1cef4f tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:17.684474 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-fce07818-0900-4fe9-91d8-70884b1cef4f tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:17.693037 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-fce07818-0900-4fe9-91d8-70884b1cef4f tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1258 microversion: 2.1 time: 0.166445 Sep 21 12:29:17.693617 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 419/828] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:29:17 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1258 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:29:17.728319 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-47880cea-7f1a-423d-a07a-c71fc5fe7560 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:17.728945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-47880cea-7f1a-423d-a07a-c71fc5fe7560 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:17.735520 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-47880cea-7f1a-423d-a07a-c71fc5fe7560 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:17.736044 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-47880cea-7f1a-423d-a07a-c71fc5fe7560 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:17.736592 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-47880cea-7f1a-423d-a07a-c71fc5fe7560 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:17.737206 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-47880cea-7f1a-423d-a07a-c71fc5fe7560 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:17.737677 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-47880cea-7f1a-423d-a07a-c71fc5fe7560 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:17.738111 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-47880cea-7f1a-423d-a07a-c71fc5fe7560 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:17.877050 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-47880cea-7f1a-423d-a07a-c71fc5fe7560 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:17.885801 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-47880cea-7f1a-423d-a07a-c71fc5fe7560 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:17.887263 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-47880cea-7f1a-423d-a07a-c71fc5fe7560 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:17.888598 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-47880cea-7f1a-423d-a07a-c71fc5fe7560 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1722 microversion: 2.20 time: 0.164833 Sep 21 12:29:17.889175 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 410/829] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:17 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:29:18.716999 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-35171634-6434-4d0e-9f95-c67c0c4e2205 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:18.717599 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-35171634-6434-4d0e-9f95-c67c0c4e2205 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:18.723877 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-35171634-6434-4d0e-9f95-c67c0c4e2205 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:18.724384 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-35171634-6434-4d0e-9f95-c67c0c4e2205 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:18.724807 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-35171634-6434-4d0e-9f95-c67c0c4e2205 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:18.725540 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-35171634-6434-4d0e-9f95-c67c0c4e2205 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:18.725936 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-35171634-6434-4d0e-9f95-c67c0c4e2205 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:18.726355 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-35171634-6434-4d0e-9f95-c67c0c4e2205 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:18.872056 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-35171634-6434-4d0e-9f95-c67c0c4e2205 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:18.879955 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-35171634-6434-4d0e-9f95-c67c0c4e2205 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1441 microversion: 2.1 time: 0.167203 Sep 21 12:29:18.880836 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 420/830] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:29:18 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1441 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:29:18.905106 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-e7313309-8b87-4f48-8a5f-b9fdf743abb0 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:18.905730 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-e7313309-8b87-4f48-8a5f-b9fdf743abb0 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:18.911781 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e7313309-8b87-4f48-8a5f-b9fdf743abb0 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:18.912310 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e7313309-8b87-4f48-8a5f-b9fdf743abb0 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:18.912758 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e7313309-8b87-4f48-8a5f-b9fdf743abb0 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:18.913526 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e7313309-8b87-4f48-8a5f-b9fdf743abb0 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:18.913990 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e7313309-8b87-4f48-8a5f-b9fdf743abb0 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:18.914534 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e7313309-8b87-4f48-8a5f-b9fdf743abb0 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:18.915621 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-ffa95679-f80e-4cbf-8c67-a3292af3fb46 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:18.916312 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-ffa95679-f80e-4cbf-8c67-a3292af3fb46 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:18.933934 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ffa95679-f80e-4cbf-8c67-a3292af3fb46 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:18.934435 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ffa95679-f80e-4cbf-8c67-a3292af3fb46 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:18.934906 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ffa95679-f80e-4cbf-8c67-a3292af3fb46 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:18.935623 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ffa95679-f80e-4cbf-8c67-a3292af3fb46 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:18.936106 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ffa95679-f80e-4cbf-8c67-a3292af3fb46 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:18.936539 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ffa95679-f80e-4cbf-8c67-a3292af3fb46 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:19.101268 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-ffa95679-f80e-4cbf-8c67-a3292af3fb46 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:19.110364 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-ffa95679-f80e-4cbf-8c67-a3292af3fb46 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:19.112107 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-ffa95679-f80e-4cbf-8c67-a3292af3fb46 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:19.113569 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-ffa95679-f80e-4cbf-8c67-a3292af3fb46 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1722 microversion: 2.20 time: 0.202593 Sep 21 12:29:19.114162 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 421/831] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:18 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:29:19.115651 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-e7313309-8b87-4f48-8a5f-b9fdf743abb0 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:19.124761 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-e7313309-8b87-4f48-8a5f-b9fdf743abb0 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1441 microversion: 2.1 time: 0.224148 Sep 21 12:29:19.125340 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 411/832] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:29:18 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1441 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:29:20.143297 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-ede4a009-60d8-4d23-953f-4741de67f0b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:20.144314 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-ede4a009-60d8-4d23-953f-4741de67f0b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:20.150638 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ede4a009-60d8-4d23-953f-4741de67f0b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:20.151133 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ede4a009-60d8-4d23-953f-4741de67f0b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:20.151624 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ede4a009-60d8-4d23-953f-4741de67f0b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:20.152367 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ede4a009-60d8-4d23-953f-4741de67f0b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:20.152825 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ede4a009-60d8-4d23-953f-4741de67f0b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:20.153299 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ede4a009-60d8-4d23-953f-4741de67f0b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:20.291291 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-ede4a009-60d8-4d23-953f-4741de67f0b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:20.300364 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-ede4a009-60d8-4d23-953f-4741de67f0b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:20.302028 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-ede4a009-60d8-4d23-953f-4741de67f0b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:20.303222 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-ede4a009-60d8-4d23-953f-4741de67f0b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1722 microversion: 2.20 time: 0.164238 Sep 21 12:29:20.316961 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 422/833] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:20 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:29:20.925328 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-44f50952-deb3-4ef8-b76f-db9858c0c413 req-966c21e6-9074-4748-9aed-33b3e4431171 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66e9cb90-c71a-420a-b647-991844d5c17c", "tag": "15af239b-da86-43fe-81e4-6adb2158f5c6"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:29:20.935718 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-44f50952-deb3-4ef8-b76f-db9858c0c413 req-966c21e6-9074-4748-9aed-33b3e4431171 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:20.936307 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-44f50952-deb3-4ef8-b76f-db9858c0c413 req-966c21e6-9074-4748-9aed-33b3e4431171 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:20.936747 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-44f50952-deb3-4ef8-b76f-db9858c0c413 req-966c21e6-9074-4748-9aed-33b3e4431171 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:20.951066 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-44f50952-deb3-4ef8-b76f-db9858c0c413 req-966c21e6-9074-4748-9aed-33b3e4431171 service nova] Creating event network-changed:15af239b-da86-43fe-81e4-6adb2158f5c6 for instance 66e9cb90-c71a-420a-b647-991844d5c17c on hv-cinder-85867 Sep 21 12:29:20.956325 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-44f50952-deb3-4ef8-b76f-db9858c0c413 req-966c21e6-9074-4748-9aed-33b3e4431171 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034707 Sep 21 12:29:20.956934 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 412/834] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 12:29:21.337261 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-01e9650b-5021-4d9e-856f-080f9734316b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:21.338010 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-01e9650b-5021-4d9e-856f-080f9734316b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:21.344887 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-01e9650b-5021-4d9e-856f-080f9734316b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:21.345588 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-01e9650b-5021-4d9e-856f-080f9734316b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:21.346325 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-01e9650b-5021-4d9e-856f-080f9734316b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:21.347050 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-01e9650b-5021-4d9e-856f-080f9734316b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:21.347512 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-01e9650b-5021-4d9e-856f-080f9734316b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:21.347973 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-01e9650b-5021-4d9e-856f-080f9734316b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:21.479730 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-01e9650b-5021-4d9e-856f-080f9734316b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:21.488931 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-01e9650b-5021-4d9e-856f-080f9734316b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:21.490494 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-01e9650b-5021-4d9e-856f-080f9734316b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:21.491668 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-01e9650b-5021-4d9e-856f-080f9734316b tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1722 microversion: 2.20 time: 0.158380 Sep 21 12:29:21.492303 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 423/835] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:21 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:29:22.519712 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-4889c397-9879-4743-a3a2-f18c0b15fba3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:22.520446 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-4889c397-9879-4743-a3a2-f18c0b15fba3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:22.526665 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4889c397-9879-4743-a3a2-f18c0b15fba3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:22.527149 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4889c397-9879-4743-a3a2-f18c0b15fba3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:22.527601 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4889c397-9879-4743-a3a2-f18c0b15fba3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:22.528952 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4889c397-9879-4743-a3a2-f18c0b15fba3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:22.529413 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4889c397-9879-4743-a3a2-f18c0b15fba3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:22.529847 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4889c397-9879-4743-a3a2-f18c0b15fba3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:22.658697 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-4889c397-9879-4743-a3a2-f18c0b15fba3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:22.666772 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-4889c397-9879-4743-a3a2-f18c0b15fba3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:22.668250 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-4889c397-9879-4743-a3a2-f18c0b15fba3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:22.669423 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-4889c397-9879-4743-a3a2-f18c0b15fba3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1722 microversion: 2.20 time: 0.154629 Sep 21 12:29:22.669983 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 413/836] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:22 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:29:23.694467 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-eb7dbdef-59b1-4e0a-8904-627ad6dc91ee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:23.695027 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-eb7dbdef-59b1-4e0a-8904-627ad6dc91ee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:23.701788 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-eb7dbdef-59b1-4e0a-8904-627ad6dc91ee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:23.702269 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-eb7dbdef-59b1-4e0a-8904-627ad6dc91ee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:23.702705 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-eb7dbdef-59b1-4e0a-8904-627ad6dc91ee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:23.703395 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-eb7dbdef-59b1-4e0a-8904-627ad6dc91ee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:23.703889 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-eb7dbdef-59b1-4e0a-8904-627ad6dc91ee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:23.704323 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-eb7dbdef-59b1-4e0a-8904-627ad6dc91ee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:23.855246 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-eb7dbdef-59b1-4e0a-8904-627ad6dc91ee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:23.865073 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-eb7dbdef-59b1-4e0a-8904-627ad6dc91ee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:23.865962 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-eb7dbdef-59b1-4e0a-8904-627ad6dc91ee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:23.866998 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-eb7dbdef-59b1-4e0a-8904-627ad6dc91ee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1722 microversion: 2.20 time: 0.176586 Sep 21 12:29:23.867574 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 424/837] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:23 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:29:24.892350 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-6dece97a-f14c-4940-8640-915d570e7838 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:24.893178 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-6dece97a-f14c-4940-8640-915d570e7838 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:24.899721 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6dece97a-f14c-4940-8640-915d570e7838 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:24.900242 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6dece97a-f14c-4940-8640-915d570e7838 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:24.900693 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6dece97a-f14c-4940-8640-915d570e7838 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:24.901435 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6dece97a-f14c-4940-8640-915d570e7838 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:24.901886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6dece97a-f14c-4940-8640-915d570e7838 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:24.902319 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6dece97a-f14c-4940-8640-915d570e7838 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:25.040550 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-6dece97a-f14c-4940-8640-915d570e7838 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:25.051939 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-6dece97a-f14c-4940-8640-915d570e7838 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:25.053463 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-6dece97a-f14c-4940-8640-915d570e7838 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:25.054725 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-6dece97a-f14c-4940-8640-915d570e7838 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1743 microversion: 2.20 time: 0.166413 Sep 21 12:29:25.055481 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 414/838] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:24 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:29:25.085224 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-ffc189ee-94a7-46c2-9d92-222f63fe7a15 req-dc8e7a80-4b99-4c76-9a28-860567adbfb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc34c677-0e22-4734-95ed-4a6834d9dc7b", "name": "network-vif-plugged", "status": "completed", "tag": "49e15f4c-39c9-4c9a-bb24-e89e5dcc9eab"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:29:25.096363 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-ffc189ee-94a7-46c2-9d92-222f63fe7a15 req-dc8e7a80-4b99-4c76-9a28-860567adbfb8 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:25.096847 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-ffc189ee-94a7-46c2-9d92-222f63fe7a15 req-dc8e7a80-4b99-4c76-9a28-860567adbfb8 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:25.097358 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-ffc189ee-94a7-46c2-9d92-222f63fe7a15 req-dc8e7a80-4b99-4c76-9a28-860567adbfb8 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:25.110183 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-ffc189ee-94a7-46c2-9d92-222f63fe7a15 req-dc8e7a80-4b99-4c76-9a28-860567adbfb8 service nova] Creating event network-vif-plugged:49e15f4c-39c9-4c9a-bb24-e89e5dcc9eab for instance dc34c677-0e22-4734-95ed-4a6834d9dc7b on hv-cinder-85867 Sep 21 12:29:25.115328 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-ffc189ee-94a7-46c2-9d92-222f63fe7a15 req-dc8e7a80-4b99-4c76-9a28-860567adbfb8 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034274 Sep 21 12:29:25.116202 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 425/839] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:29:26.081825 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-b4ce9bf2-b250-417b-9819-7e49cd5d337f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:26.082467 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-b4ce9bf2-b250-417b-9819-7e49cd5d337f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:26.089017 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b4ce9bf2-b250-417b-9819-7e49cd5d337f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:26.089521 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b4ce9bf2-b250-417b-9819-7e49cd5d337f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:26.089981 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b4ce9bf2-b250-417b-9819-7e49cd5d337f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:26.091169 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b4ce9bf2-b250-417b-9819-7e49cd5d337f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:26.091636 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b4ce9bf2-b250-417b-9819-7e49cd5d337f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:26.092095 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b4ce9bf2-b250-417b-9819-7e49cd5d337f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:26.107469 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:29:26.244477 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-b4ce9bf2-b250-417b-9819-7e49cd5d337f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:26.252764 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-b4ce9bf2-b250-417b-9819-7e49cd5d337f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:26.254210 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-b4ce9bf2-b250-417b-9819-7e49cd5d337f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:26.255377 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-b4ce9bf2-b250-417b-9819-7e49cd5d337f tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1743 microversion: 2.20 time: 0.177624 Sep 21 12:29:26.255997 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 415/840] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:26 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1743 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:29:27.288089 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-080bfd4a-dabf-4425-a401-6827b71614bb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:27.288728 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-080bfd4a-dabf-4425-a401-6827b71614bb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:27.304103 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-080bfd4a-dabf-4425-a401-6827b71614bb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:27.304603 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-080bfd4a-dabf-4425-a401-6827b71614bb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:27.305048 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-080bfd4a-dabf-4425-a401-6827b71614bb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:27.305766 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-080bfd4a-dabf-4425-a401-6827b71614bb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:27.306223 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-080bfd4a-dabf-4425-a401-6827b71614bb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:27.306656 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-080bfd4a-dabf-4425-a401-6827b71614bb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:27.439315 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-080bfd4a-dabf-4425-a401-6827b71614bb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:27.442909 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=100 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:29:27.448559 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-080bfd4a-dabf-4425-a401-6827b71614bb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:27.450024 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-080bfd4a-dabf-4425-a401-6827b71614bb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:27.451197 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-080bfd4a-dabf-4425-a401-6827b71614bb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1743 microversion: 2.20 time: 0.170321 Sep 21 12:29:27.451793 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 426/841] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:27 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1743 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:29:28.476981 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-8b6710f6-d78b-4b97-9d11-f031376fe479 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:28.477962 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-8b6710f6-d78b-4b97-9d11-f031376fe479 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:28.486247 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8b6710f6-d78b-4b97-9d11-f031376fe479 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:28.486742 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8b6710f6-d78b-4b97-9d11-f031376fe479 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:28.487222 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8b6710f6-d78b-4b97-9d11-f031376fe479 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:28.487969 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8b6710f6-d78b-4b97-9d11-f031376fe479 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:28.488432 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8b6710f6-d78b-4b97-9d11-f031376fe479 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:28.488866 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8b6710f6-d78b-4b97-9d11-f031376fe479 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:28.676542 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-8b6710f6-d78b-4b97-9d11-f031376fe479 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:28.692853 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-8b6710f6-d78b-4b97-9d11-f031376fe479 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:28.694459 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-8b6710f6-d78b-4b97-9d11-f031376fe479 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:28.695646 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-8b6710f6-d78b-4b97-9d11-f031376fe479 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1743 microversion: 2.20 time: 0.222795 Sep 21 12:29:28.696502 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 416/842] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:28 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1743 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:29:29.722883 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-3b21d817-dc03-49f1-b93b-a7ef790fa34d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:29.723520 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-3b21d817-dc03-49f1-b93b-a7ef790fa34d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:29.730350 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3b21d817-dc03-49f1-b93b-a7ef790fa34d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:29.730881 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3b21d817-dc03-49f1-b93b-a7ef790fa34d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:29.731322 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3b21d817-dc03-49f1-b93b-a7ef790fa34d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:29.732072 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3b21d817-dc03-49f1-b93b-a7ef790fa34d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:29.732533 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3b21d817-dc03-49f1-b93b-a7ef790fa34d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:29.732962 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3b21d817-dc03-49f1-b93b-a7ef790fa34d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:29.872708 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-3b21d817-dc03-49f1-b93b-a7ef790fa34d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:29.881346 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-3b21d817-dc03-49f1-b93b-a7ef790fa34d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:29.882798 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-3b21d817-dc03-49f1-b93b-a7ef790fa34d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:29.884025 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-3b21d817-dc03-49f1-b93b-a7ef790fa34d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1743 microversion: 2.20 time: 0.165384 Sep 21 12:29:29.884590 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 427/843] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:29 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:29:30.911203 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-51440d79-0850-4b74-ae04-edd595f4dfae tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:30.912672 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-51440d79-0850-4b74-ae04-edd595f4dfae tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:30.922886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-51440d79-0850-4b74-ae04-edd595f4dfae tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:30.923647 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-51440d79-0850-4b74-ae04-edd595f4dfae tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:30.924331 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-51440d79-0850-4b74-ae04-edd595f4dfae tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:30.925214 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-51440d79-0850-4b74-ae04-edd595f4dfae tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:30.925838 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-51440d79-0850-4b74-ae04-edd595f4dfae tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:30.926456 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-51440d79-0850-4b74-ae04-edd595f4dfae tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:31.079026 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-51440d79-0850-4b74-ae04-edd595f4dfae tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:31.087456 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-51440d79-0850-4b74-ae04-edd595f4dfae tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:31.090259 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-51440d79-0850-4b74-ae04-edd595f4dfae tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:31.091697 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-51440d79-0850-4b74-ae04-edd595f4dfae tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1738 microversion: 2.20 time: 0.185538 Sep 21 12:29:31.092791 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 417/844] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:30 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:29:32.118574 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-c66e99e5-57a0-428a-9edf-cb4ca3ba9ffe tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:32.119963 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-c66e99e5-57a0-428a-9edf-cb4ca3ba9ffe tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:32.126763 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c66e99e5-57a0-428a-9edf-cb4ca3ba9ffe tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:32.127254 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c66e99e5-57a0-428a-9edf-cb4ca3ba9ffe tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:32.127712 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c66e99e5-57a0-428a-9edf-cb4ca3ba9ffe tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:32.128435 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c66e99e5-57a0-428a-9edf-cb4ca3ba9ffe tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:32.128896 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c66e99e5-57a0-428a-9edf-cb4ca3ba9ffe tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:32.129323 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c66e99e5-57a0-428a-9edf-cb4ca3ba9ffe tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:32.329270 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-c66e99e5-57a0-428a-9edf-cb4ca3ba9ffe tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:32.338836 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-c66e99e5-57a0-428a-9edf-cb4ca3ba9ffe tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:32.341185 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-c66e99e5-57a0-428a-9edf-cb4ca3ba9ffe tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:32.342603 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-c66e99e5-57a0-428a-9edf-cb4ca3ba9ffe tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1738 microversion: 2.20 time: 0.227873 Sep 21 12:29:32.344233 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 428/845] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:32 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1738 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:29:33.370818 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-4cac59e2-f5e2-42cf-a08b-2730c4515ad3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:33.371920 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-4cac59e2-f5e2-42cf-a08b-2730c4515ad3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:33.378776 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4cac59e2-f5e2-42cf-a08b-2730c4515ad3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:33.379459 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4cac59e2-f5e2-42cf-a08b-2730c4515ad3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:33.379939 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4cac59e2-f5e2-42cf-a08b-2730c4515ad3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:33.380649 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4cac59e2-f5e2-42cf-a08b-2730c4515ad3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:33.381273 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4cac59e2-f5e2-42cf-a08b-2730c4515ad3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:33.381899 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4cac59e2-f5e2-42cf-a08b-2730c4515ad3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:33.533395 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-4cac59e2-f5e2-42cf-a08b-2730c4515ad3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:33.541619 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-4cac59e2-f5e2-42cf-a08b-2730c4515ad3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:33.543123 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-4cac59e2-f5e2-42cf-a08b-2730c4515ad3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:33.544334 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-4cac59e2-f5e2-42cf-a08b-2730c4515ad3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1738 microversion: 2.20 time: 0.177758 Sep 21 12:29:33.544935 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 418/846] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:33 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:29:34.574231 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-42bb3845-332c-4cdd-982a-e09e3ea57e57 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:34.575319 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-42bb3845-332c-4cdd-982a-e09e3ea57e57 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:34.584362 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-42bb3845-332c-4cdd-982a-e09e3ea57e57 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:34.585029 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-42bb3845-332c-4cdd-982a-e09e3ea57e57 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:34.586412 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-42bb3845-332c-4cdd-982a-e09e3ea57e57 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:34.587657 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-42bb3845-332c-4cdd-982a-e09e3ea57e57 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:34.588328 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-42bb3845-332c-4cdd-982a-e09e3ea57e57 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:34.588760 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-42bb3845-332c-4cdd-982a-e09e3ea57e57 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:34.759984 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-42bb3845-332c-4cdd-982a-e09e3ea57e57 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:34.775932 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-42bb3845-332c-4cdd-982a-e09e3ea57e57 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:34.777490 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-42bb3845-332c-4cdd-982a-e09e3ea57e57 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:34.778754 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-42bb3845-332c-4cdd-982a-e09e3ea57e57 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1738 microversion: 2.20 time: 0.209657 Sep 21 12:29:34.800251 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 429/847] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:34 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1738 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:29:35.821911 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-b057c5d1-98a4-445d-b404-57b601e0d05e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:35.826730 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-b057c5d1-98a4-445d-b404-57b601e0d05e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:35.841522 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=40 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:29:35.846374 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b057c5d1-98a4-445d-b404-57b601e0d05e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:35.847153 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b057c5d1-98a4-445d-b404-57b601e0d05e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:35.847678 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b057c5d1-98a4-445d-b404-57b601e0d05e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:35.848566 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b057c5d1-98a4-445d-b404-57b601e0d05e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:35.849318 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b057c5d1-98a4-445d-b404-57b601e0d05e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:35.850709 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b057c5d1-98a4-445d-b404-57b601e0d05e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:36.039986 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-b057c5d1-98a4-445d-b404-57b601e0d05e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:36.048581 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-b057c5d1-98a4-445d-b404-57b601e0d05e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:36.050099 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-b057c5d1-98a4-445d-b404-57b601e0d05e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:36.051276 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-b057c5d1-98a4-445d-b404-57b601e0d05e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1738 microversion: 2.20 time: 0.239755 Sep 21 12:29:36.052040 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 419/848] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:35 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1738 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:29:37.080526 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-89e299da-9dc0-4a88-8755-a17826560eb3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:37.082627 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-89e299da-9dc0-4a88-8755-a17826560eb3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:37.090282 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-89e299da-9dc0-4a88-8755-a17826560eb3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:37.090963 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-89e299da-9dc0-4a88-8755-a17826560eb3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:37.091409 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-89e299da-9dc0-4a88-8755-a17826560eb3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:37.092408 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-89e299da-9dc0-4a88-8755-a17826560eb3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:37.093032 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-89e299da-9dc0-4a88-8755-a17826560eb3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:37.093453 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-89e299da-9dc0-4a88-8755-a17826560eb3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:37.248081 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-89e299da-9dc0-4a88-8755-a17826560eb3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:37.257658 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-89e299da-9dc0-4a88-8755-a17826560eb3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:37.259456 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-89e299da-9dc0-4a88-8755-a17826560eb3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:37.260988 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-89e299da-9dc0-4a88-8755-a17826560eb3 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1738 microversion: 2.20 time: 0.185009 Sep 21 12:29:37.262142 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 430/849] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:37 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:29:38.292460 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-1753798a-94c2-4741-8583-58c19d235eee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:38.292460 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-1753798a-94c2-4741-8583-58c19d235eee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:38.301875 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1753798a-94c2-4741-8583-58c19d235eee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:38.302380 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1753798a-94c2-4741-8583-58c19d235eee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:38.302830 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1753798a-94c2-4741-8583-58c19d235eee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:38.303565 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1753798a-94c2-4741-8583-58c19d235eee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:38.304165 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1753798a-94c2-4741-8583-58c19d235eee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:38.304484 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1753798a-94c2-4741-8583-58c19d235eee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:38.455025 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-1753798a-94c2-4741-8583-58c19d235eee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:38.465759 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-1753798a-94c2-4741-8583-58c19d235eee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:38.468556 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-1753798a-94c2-4741-8583-58c19d235eee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:38.470317 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-1753798a-94c2-4741-8583-58c19d235eee tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1738 microversion: 2.20 time: 0.184494 Sep 21 12:29:38.470888 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 420/850] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:38 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:29:39.498288 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-896089da-76f9-4919-baf1-9fba0fab9e83 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:39.499667 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-896089da-76f9-4919-baf1-9fba0fab9e83 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:39.507486 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-896089da-76f9-4919-baf1-9fba0fab9e83 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:39.508158 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-896089da-76f9-4919-baf1-9fba0fab9e83 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:39.508858 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-896089da-76f9-4919-baf1-9fba0fab9e83 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:39.509837 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-896089da-76f9-4919-baf1-9fba0fab9e83 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:39.510463 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-896089da-76f9-4919-baf1-9fba0fab9e83 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:39.510963 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-896089da-76f9-4919-baf1-9fba0fab9e83 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:39.657653 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-896089da-76f9-4919-baf1-9fba0fab9e83 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:39.669527 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-896089da-76f9-4919-baf1-9fba0fab9e83 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:39.671867 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-896089da-76f9-4919-baf1-9fba0fab9e83 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:39.673523 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-896089da-76f9-4919-baf1-9fba0fab9e83 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1738 microversion: 2.20 time: 0.180113 Sep 21 12:29:39.674814 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 431/851] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:39 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:29:40.702091 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-0027b415-6798-4ceb-a351-8b4b95864a5e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:40.703473 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-0027b415-6798-4ceb-a351-8b4b95864a5e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:40.710184 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0027b415-6798-4ceb-a351-8b4b95864a5e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:40.710776 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0027b415-6798-4ceb-a351-8b4b95864a5e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:40.711391 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0027b415-6798-4ceb-a351-8b4b95864a5e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:40.712353 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0027b415-6798-4ceb-a351-8b4b95864a5e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:40.713028 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0027b415-6798-4ceb-a351-8b4b95864a5e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:40.713666 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0027b415-6798-4ceb-a351-8b4b95864a5e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:40.858690 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-0027b415-6798-4ceb-a351-8b4b95864a5e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:40.867479 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-0027b415-6798-4ceb-a351-8b4b95864a5e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:40.868973 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-0027b415-6798-4ceb-a351-8b4b95864a5e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:40.870382 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-0027b415-6798-4ceb-a351-8b4b95864a5e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1738 microversion: 2.20 time: 0.173047 Sep 21 12:29:40.871157 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 421/852] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:40 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:29:41.897057 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-60f33b1d-44bd-4e47-80c5-a951408ab149 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:41.897671 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-60f33b1d-44bd-4e47-80c5-a951408ab149 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:41.905351 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-60f33b1d-44bd-4e47-80c5-a951408ab149 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:41.906152 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-60f33b1d-44bd-4e47-80c5-a951408ab149 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:41.906797 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-60f33b1d-44bd-4e47-80c5-a951408ab149 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:41.907745 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-60f33b1d-44bd-4e47-80c5-a951408ab149 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:41.908520 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-60f33b1d-44bd-4e47-80c5-a951408ab149 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:41.909108 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-60f33b1d-44bd-4e47-80c5-a951408ab149 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:42.047447 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-60f33b1d-44bd-4e47-80c5-a951408ab149 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:42.056401 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-60f33b1d-44bd-4e47-80c5-a951408ab149 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:42.059159 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-60f33b1d-44bd-4e47-80c5-a951408ab149 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:42.060821 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-60f33b1d-44bd-4e47-80c5-a951408ab149 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1738 microversion: 2.20 time: 0.167694 Sep 21 12:29:42.062269 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 432/853] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:41 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:29:43.087598 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-1d7b57be-9d7d-4df7-8ab7-242c47268fcb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:43.088324 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-1d7b57be-9d7d-4df7-8ab7-242c47268fcb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:43.094714 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1d7b57be-9d7d-4df7-8ab7-242c47268fcb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:43.095209 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1d7b57be-9d7d-4df7-8ab7-242c47268fcb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:43.095650 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1d7b57be-9d7d-4df7-8ab7-242c47268fcb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:43.096400 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1d7b57be-9d7d-4df7-8ab7-242c47268fcb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:43.096859 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1d7b57be-9d7d-4df7-8ab7-242c47268fcb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:43.097290 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1d7b57be-9d7d-4df7-8ab7-242c47268fcb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:43.247303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-1d7b57be-9d7d-4df7-8ab7-242c47268fcb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:43.255319 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-1d7b57be-9d7d-4df7-8ab7-242c47268fcb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:43.256810 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-1d7b57be-9d7d-4df7-8ab7-242c47268fcb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:43.257974 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-1d7b57be-9d7d-4df7-8ab7-242c47268fcb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1738 microversion: 2.20 time: 0.174353 Sep 21 12:29:43.258536 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 422/854] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:43 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:29:44.284207 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-1bf988f6-9b12-4205-ad53-c58bb126bf41 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:44.284826 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-1bf988f6-9b12-4205-ad53-c58bb126bf41 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:44.287110 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_api:SELECT=36 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:29:44.292498 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1bf988f6-9b12-4205-ad53-c58bb126bf41 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:44.292982 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1bf988f6-9b12-4205-ad53-c58bb126bf41 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:44.293421 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1bf988f6-9b12-4205-ad53-c58bb126bf41 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:44.294115 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1bf988f6-9b12-4205-ad53-c58bb126bf41 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:44.294572 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1bf988f6-9b12-4205-ad53-c58bb126bf41 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:44.295000 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1bf988f6-9b12-4205-ad53-c58bb126bf41 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:44.427337 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-1bf988f6-9b12-4205-ad53-c58bb126bf41 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:44.435423 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-1bf988f6-9b12-4205-ad53-c58bb126bf41 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:44.436905 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-1bf988f6-9b12-4205-ad53-c58bb126bf41 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:44.438070 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-1bf988f6-9b12-4205-ad53-c58bb126bf41 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1720 microversion: 2.20 time: 0.157834 Sep 21 12:29:44.438629 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 433/855] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:44 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:29:45.464127 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-30b8de33-8ff7-492c-962f-fc8ab66c9098 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:45.465291 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-30b8de33-8ff7-492c-962f-fc8ab66c9098 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:45.474284 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-30b8de33-8ff7-492c-962f-fc8ab66c9098 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:45.474284 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-30b8de33-8ff7-492c-962f-fc8ab66c9098 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:45.474737 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-30b8de33-8ff7-492c-962f-fc8ab66c9098 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:45.475440 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-30b8de33-8ff7-492c-962f-fc8ab66c9098 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:45.475928 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-30b8de33-8ff7-492c-962f-fc8ab66c9098 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:45.476384 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-30b8de33-8ff7-492c-962f-fc8ab66c9098 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:45.629524 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-30b8de33-8ff7-492c-962f-fc8ab66c9098 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:45.638605 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-30b8de33-8ff7-492c-962f-fc8ab66c9098 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:45.640080 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-30b8de33-8ff7-492c-962f-fc8ab66c9098 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:45.641253 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-30b8de33-8ff7-492c-962f-fc8ab66c9098 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1720 microversion: 2.20 time: 0.181264 Sep 21 12:29:45.641859 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 423/856] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:45 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1720 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:29:46.666624 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-c5d5b099-c10a-4095-8b9c-979dfe3dd375 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:46.667277 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-c5d5b099-c10a-4095-8b9c-979dfe3dd375 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:46.674640 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c5d5b099-c10a-4095-8b9c-979dfe3dd375 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:46.675035 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c5d5b099-c10a-4095-8b9c-979dfe3dd375 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:46.675511 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c5d5b099-c10a-4095-8b9c-979dfe3dd375 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:46.676137 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c5d5b099-c10a-4095-8b9c-979dfe3dd375 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:46.676595 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c5d5b099-c10a-4095-8b9c-979dfe3dd375 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:46.677022 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c5d5b099-c10a-4095-8b9c-979dfe3dd375 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:46.815894 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-c5d5b099-c10a-4095-8b9c-979dfe3dd375 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:46.825298 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-c5d5b099-c10a-4095-8b9c-979dfe3dd375 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:46.826743 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-c5d5b099-c10a-4095-8b9c-979dfe3dd375 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:46.827989 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-c5d5b099-c10a-4095-8b9c-979dfe3dd375 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1663 microversion: 2.20 time: 0.165437 Sep 21 12:29:46.828588 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 434/857] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:46 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1663 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:29:46.854166 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-d60b9c9b-6fb5-4d60-8fb7-878a987bfbff tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "338b7ee5-3bd7-4ea9-9279-a32412c45992"}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:29:46.857476 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-d60b9c9b-6fb5-4d60-8fb7-878a987bfbff tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:46.864609 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d60b9c9b-6fb5-4d60-8fb7-878a987bfbff tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:46.865240 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d60b9c9b-6fb5-4d60-8fb7-878a987bfbff tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:46.865754 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d60b9c9b-6fb5-4d60-8fb7-878a987bfbff tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:46.866555 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d60b9c9b-6fb5-4d60-8fb7-878a987bfbff tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:46.867091 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d60b9c9b-6fb5-4d60-8fb7-878a987bfbff tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:46.867596 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d60b9c9b-6fb5-4d60-8fb7-878a987bfbff tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:47.149291 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-f4c55216-201f-4c07-bc5c-f4ca542afd51 req-0d38e7a4-576b-43f5-b82e-6db0708a038c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc34c677-0e22-4734-95ed-4a6834d9dc7b", "name": "network-vif-unplugged", "status": "completed", "tag": "49e15f4c-39c9-4c9a-bb24-e89e5dcc9eab"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:29:47.161418 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-f4c55216-201f-4c07-bc5c-f4ca542afd51 req-0d38e7a4-576b-43f5-b82e-6db0708a038c service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:47.162362 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-f4c55216-201f-4c07-bc5c-f4ca542afd51 req-0d38e7a4-576b-43f5-b82e-6db0708a038c service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:47.163012 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-f4c55216-201f-4c07-bc5c-f4ca542afd51 req-0d38e7a4-576b-43f5-b82e-6db0708a038c service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:47.177484 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.compute.server_external_events [req-f4c55216-201f-4c07-bc5c-f4ca542afd51 req-0d38e7a4-576b-43f5-b82e-6db0708a038c service nova] Unable to find a host for instance dc34c677-0e22-4734-95ed-4a6834d9dc7b. Dropping event network-vif-unplugged {{(pid=120462) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 21 12:29:47.179127 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-f4c55216-201f-4c07-bc5c-f4ca542afd51 req-0d38e7a4-576b-43f5-b82e-6db0708a038c service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033407 Sep 21 12:29:47.180382 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 435/858] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 21 12:29:47.267507 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-d60b9c9b-6fb5-4d60-8fb7-878a987bfbff tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "POST /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.417423 Sep 21 12:29:47.268193 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 424/859] 10.222.0.71 () {62 vars in 1364 bytes} [Wed Sep 21 12:29:46 2022] POST /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b/os-volume_attachments => generated 188 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 12:29:47.409123 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-1e859273-9766-4ffd-ab56-b63241784cc1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:47.409623 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-1e859273-9766-4ffd-ab56-b63241784cc1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:47.415541 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1e859273-9766-4ffd-ab56-b63241784cc1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:47.416064 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1e859273-9766-4ffd-ab56-b63241784cc1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:47.416508 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1e859273-9766-4ffd-ab56-b63241784cc1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:47.417214 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1e859273-9766-4ffd-ab56-b63241784cc1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:47.417707 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1e859273-9766-4ffd-ab56-b63241784cc1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:47.418138 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1e859273-9766-4ffd-ab56-b63241784cc1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:47.693879 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-1e859273-9766-4ffd-ab56-b63241784cc1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "DELETE /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b/os-volume_attachments/338b7ee5-3bd7-4ea9-9279-a32412c45992" status: 202 len: 0 microversion: 2.20 time: 0.288462 Sep 21 12:29:47.694653 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 436/860] 10.222.0.71 () {60 vars in 1457 bytes} [Wed Sep 21 12:29:47 2022] DELETE /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b/os-volume_attachments/338b7ee5-3bd7-4ea9-9279-a32412c45992 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 21 12:29:47.758561 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-ee5d5f77-df95-4a82-b24c-441855608ba8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:29:47.759164 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-ee5d5f77-df95-4a82-b24c-441855608ba8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:47.766461 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ee5d5f77-df95-4a82-b24c-441855608ba8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:47.766952 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ee5d5f77-df95-4a82-b24c-441855608ba8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:47.767389 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ee5d5f77-df95-4a82-b24c-441855608ba8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:47.768123 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ee5d5f77-df95-4a82-b24c-441855608ba8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:47.768578 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ee5d5f77-df95-4a82-b24c-441855608ba8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:47.769005 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ee5d5f77-df95-4a82-b24c-441855608ba8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:47.814757 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-ee5d5f77-df95-4a82-b24c-441855608ba8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120463) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 21 12:29:47.893338 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-ee5d5f77-df95-4a82-b24c-441855608ba8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "POST /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b/action" status: 202 len: 0 microversion: 2.20 time: 0.138806 Sep 21 12:29:47.897246 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 425/861] 10.222.0.71 () {62 vars in 1319 bytes} [Wed Sep 21 12:29:47 2022] POST /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 21 12:29:47.902624 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-71637921-19c1-4514-9076-48d5c93ed2ec tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:47.903242 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-71637921-19c1-4514-9076-48d5c93ed2ec tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:47.910226 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-71637921-19c1-4514-9076-48d5c93ed2ec tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:47.910961 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-71637921-19c1-4514-9076-48d5c93ed2ec tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:47.911476 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-71637921-19c1-4514-9076-48d5c93ed2ec tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:47.912230 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-71637921-19c1-4514-9076-48d5c93ed2ec tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:47.912683 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-71637921-19c1-4514-9076-48d5c93ed2ec tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:47.913476 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-71637921-19c1-4514-9076-48d5c93ed2ec tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:48.234967 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-71637921-19c1-4514-9076-48d5c93ed2ec tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:48.244179 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-71637921-19c1-4514-9076-48d5c93ed2ec tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:48.248587 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-71637921-19c1-4514-9076-48d5c93ed2ec tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:48.248587 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-71637921-19c1-4514-9076-48d5c93ed2ec tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1671 microversion: 2.20 time: 0.348911 Sep 21 12:29:48.248587 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 437/862] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:47 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1671 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:29:49.272417 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-2a8a746c-c441-4155-9f79-81486f81158e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:49.273114 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-2a8a746c-c441-4155-9f79-81486f81158e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:49.279074 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2a8a746c-c441-4155-9f79-81486f81158e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:49.279637 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2a8a746c-c441-4155-9f79-81486f81158e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:49.280114 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2a8a746c-c441-4155-9f79-81486f81158e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:49.280904 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2a8a746c-c441-4155-9f79-81486f81158e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:49.281360 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2a8a746c-c441-4155-9f79-81486f81158e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:49.281786 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2a8a746c-c441-4155-9f79-81486f81158e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:49.432553 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-2a8a746c-c441-4155-9f79-81486f81158e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:49.442068 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-2a8a746c-c441-4155-9f79-81486f81158e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:49.443567 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-2a8a746c-c441-4155-9f79-81486f81158e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:49.445515 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-2a8a746c-c441-4155-9f79-81486f81158e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1729 microversion: 2.20 time: 0.176971 Sep 21 12:29:49.446371 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 426/863] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:49 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:29:50.472815 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-3ecc196b-d7ab-4316-b03e-a5938e35b7b9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:50.474136 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-3ecc196b-d7ab-4316-b03e-a5938e35b7b9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:50.484589 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3ecc196b-d7ab-4316-b03e-a5938e35b7b9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:50.485165 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3ecc196b-d7ab-4316-b03e-a5938e35b7b9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:50.485514 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3ecc196b-d7ab-4316-b03e-a5938e35b7b9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:50.486226 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3ecc196b-d7ab-4316-b03e-a5938e35b7b9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:50.486686 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3ecc196b-d7ab-4316-b03e-a5938e35b7b9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:50.490710 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3ecc196b-d7ab-4316-b03e-a5938e35b7b9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:50.685743 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-3ecc196b-d7ab-4316-b03e-a5938e35b7b9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:50.694797 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-3ecc196b-d7ab-4316-b03e-a5938e35b7b9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:50.696284 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-3ecc196b-d7ab-4316-b03e-a5938e35b7b9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:50.697466 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-3ecc196b-d7ab-4316-b03e-a5938e35b7b9 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1729 microversion: 2.20 time: 0.229873 Sep 21 12:29:50.699257 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 438/864] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:50 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1729 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:29:51.726432 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-45e4fff8-71df-4670-a5a4-e1dbb72e9b6e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:51.727173 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-45e4fff8-71df-4670-a5a4-e1dbb72e9b6e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:51.734136 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-45e4fff8-71df-4670-a5a4-e1dbb72e9b6e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:51.734641 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-45e4fff8-71df-4670-a5a4-e1dbb72e9b6e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:51.735088 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-45e4fff8-71df-4670-a5a4-e1dbb72e9b6e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:51.735826 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-45e4fff8-71df-4670-a5a4-e1dbb72e9b6e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:51.736295 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-45e4fff8-71df-4670-a5a4-e1dbb72e9b6e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:51.736731 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-45e4fff8-71df-4670-a5a4-e1dbb72e9b6e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:51.922474 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-45e4fff8-71df-4670-a5a4-e1dbb72e9b6e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:51.932813 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-45e4fff8-71df-4670-a5a4-e1dbb72e9b6e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:51.934695 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-45e4fff8-71df-4670-a5a4-e1dbb72e9b6e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:51.936005 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-45e4fff8-71df-4670-a5a4-e1dbb72e9b6e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1729 microversion: 2.20 time: 0.213687 Sep 21 12:29:51.936575 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 427/865] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:51 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1729 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:29:52.964160 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-8738f0dd-f492-4cb2-b2a4-5874fcffcfb8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:52.964958 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-8738f0dd-f492-4cb2-b2a4-5874fcffcfb8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:52.971676 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8738f0dd-f492-4cb2-b2a4-5874fcffcfb8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:52.972301 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8738f0dd-f492-4cb2-b2a4-5874fcffcfb8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:52.972821 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8738f0dd-f492-4cb2-b2a4-5874fcffcfb8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:52.973596 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8738f0dd-f492-4cb2-b2a4-5874fcffcfb8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:52.974135 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8738f0dd-f492-4cb2-b2a4-5874fcffcfb8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:52.974633 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8738f0dd-f492-4cb2-b2a4-5874fcffcfb8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:53.150804 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-8738f0dd-f492-4cb2-b2a4-5874fcffcfb8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:53.160021 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-8738f0dd-f492-4cb2-b2a4-5874fcffcfb8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:53.161480 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-8738f0dd-f492-4cb2-b2a4-5874fcffcfb8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:53.164951 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-8738f0dd-f492-4cb2-b2a4-5874fcffcfb8 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1729 microversion: 2.20 time: 0.202822 Sep 21 12:29:53.165873 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 439/866] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:52 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1729 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:29:54.206855 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-96347301-842d-4495-9a4d-e3bee0f24936 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:54.207405 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-96347301-842d-4495-9a4d-e3bee0f24936 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:54.213981 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-96347301-842d-4495-9a4d-e3bee0f24936 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:54.214472 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-96347301-842d-4495-9a4d-e3bee0f24936 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:54.214915 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-96347301-842d-4495-9a4d-e3bee0f24936 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:54.215624 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-96347301-842d-4495-9a4d-e3bee0f24936 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:54.216127 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-96347301-842d-4495-9a4d-e3bee0f24936 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:54.216631 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-96347301-842d-4495-9a4d-e3bee0f24936 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:54.233071 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:29:54.356907 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-96347301-842d-4495-9a4d-e3bee0f24936 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:54.366010 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-96347301-842d-4495-9a4d-e3bee0f24936 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:54.367931 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-96347301-842d-4495-9a4d-e3bee0f24936 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:54.369382 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-96347301-842d-4495-9a4d-e3bee0f24936 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1729 microversion: 2.20 time: 0.166815 Sep 21 12:29:54.379990 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 428/867] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:54 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:29:55.395691 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-33d8ea7c-4525-40a8-94d2-8f396c36e261 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:55.396438 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-33d8ea7c-4525-40a8-94d2-8f396c36e261 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:55.403174 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-33d8ea7c-4525-40a8-94d2-8f396c36e261 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:55.403705 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-33d8ea7c-4525-40a8-94d2-8f396c36e261 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:55.404358 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-33d8ea7c-4525-40a8-94d2-8f396c36e261 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:55.405973 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-33d8ea7c-4525-40a8-94d2-8f396c36e261 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:55.406480 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-33d8ea7c-4525-40a8-94d2-8f396c36e261 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:55.406906 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-33d8ea7c-4525-40a8-94d2-8f396c36e261 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:55.588915 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-33d8ea7c-4525-40a8-94d2-8f396c36e261 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:55.597565 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-33d8ea7c-4525-40a8-94d2-8f396c36e261 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:55.599168 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-33d8ea7c-4525-40a8-94d2-8f396c36e261 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:55.600463 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-33d8ea7c-4525-40a8-94d2-8f396c36e261 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1729 microversion: 2.20 time: 0.209294 Sep 21 12:29:55.601701 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 440/868] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:55 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1729 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:29:55.651454 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-cf72e58d-50ab-4da8-8dcc-ca7685ab8adc tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:55.651974 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-cf72e58d-50ab-4da8-8dcc-ca7685ab8adc tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:55.658782 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cf72e58d-50ab-4da8-8dcc-ca7685ab8adc tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:55.659357 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cf72e58d-50ab-4da8-8dcc-ca7685ab8adc tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:55.659905 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cf72e58d-50ab-4da8-8dcc-ca7685ab8adc tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:55.660690 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cf72e58d-50ab-4da8-8dcc-ca7685ab8adc tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:55.661518 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cf72e58d-50ab-4da8-8dcc-ca7685ab8adc tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:55.662042 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cf72e58d-50ab-4da8-8dcc-ca7685ab8adc tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:55.688585 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-cf72e58d-50ab-4da8-8dcc-ca7685ab8adc tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c/ips" status: 200 len: 145 microversion: 2.1 time: 0.041079 Sep 21 12:29:55.689274 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 429/869] 10.222.0.71 () {58 vars in 1248 bytes} [Wed Sep 21 12:29:55 2022] GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:29:56.628921 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-81fba781-c2fe-4193-8160-2a427b74a072 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:56.629630 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-81fba781-c2fe-4193-8160-2a427b74a072 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:56.636247 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-81fba781-c2fe-4193-8160-2a427b74a072 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:56.636813 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-81fba781-c2fe-4193-8160-2a427b74a072 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:56.637332 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-81fba781-c2fe-4193-8160-2a427b74a072 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:56.638123 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-81fba781-c2fe-4193-8160-2a427b74a072 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:56.638654 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-81fba781-c2fe-4193-8160-2a427b74a072 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:56.639152 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-81fba781-c2fe-4193-8160-2a427b74a072 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:56.822045 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-81fba781-c2fe-4193-8160-2a427b74a072 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:56.824568 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:29:56.832005 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-81fba781-c2fe-4193-8160-2a427b74a072 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:56.833621 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-81fba781-c2fe-4193-8160-2a427b74a072 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:56.834868 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-81fba781-c2fe-4193-8160-2a427b74a072 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1729 microversion: 2.20 time: 0.210015 Sep 21 12:29:56.835656 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 441/870] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:56 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1729 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:29:57.116806 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-48b9b431-647f-41bc-a22f-18581edbab20 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d6545e7-490c-4990-a7db-9df50eee202b"}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:29:57.119389 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-48b9b431-647f-41bc-a22f-18581edbab20 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:57.126740 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-48b9b431-647f-41bc-a22f-18581edbab20 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:57.127312 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-48b9b431-647f-41bc-a22f-18581edbab20 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:57.127781 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-48b9b431-647f-41bc-a22f-18581edbab20 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:57.128617 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-48b9b431-647f-41bc-a22f-18581edbab20 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:57.129082 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-48b9b431-647f-41bc-a22f-18581edbab20 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:57.129612 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-48b9b431-647f-41bc-a22f-18581edbab20 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:57.862898 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-4ef0bb4f-6e7b-4dae-a156-6f955fd0dfef tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:57.864207 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-4ef0bb4f-6e7b-4dae-a156-6f955fd0dfef tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:57.873372 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4ef0bb4f-6e7b-4dae-a156-6f955fd0dfef tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:57.873877 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4ef0bb4f-6e7b-4dae-a156-6f955fd0dfef tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:57.874321 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4ef0bb4f-6e7b-4dae-a156-6f955fd0dfef tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:57.875043 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4ef0bb4f-6e7b-4dae-a156-6f955fd0dfef tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:57.875504 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4ef0bb4f-6e7b-4dae-a156-6f955fd0dfef tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:57.876357 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4ef0bb4f-6e7b-4dae-a156-6f955fd0dfef tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:58.028961 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-4ef0bb4f-6e7b-4dae-a156-6f955fd0dfef tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:58.037448 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-4ef0bb4f-6e7b-4dae-a156-6f955fd0dfef tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:58.038924 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-4ef0bb4f-6e7b-4dae-a156-6f955fd0dfef tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:58.040153 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-4ef0bb4f-6e7b-4dae-a156-6f955fd0dfef tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1729 microversion: 2.20 time: 0.181461 Sep 21 12:29:58.052160 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 442/871] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:57 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:29:59.072530 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-39ba27a5-c119-4fa3-ac48-36b6a54c0504 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:29:59.075426 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-39ba27a5-c119-4fa3-ac48-36b6a54c0504 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:29:59.082599 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-39ba27a5-c119-4fa3-ac48-36b6a54c0504 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:59.083086 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-39ba27a5-c119-4fa3-ac48-36b6a54c0504 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:59.083527 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-39ba27a5-c119-4fa3-ac48-36b6a54c0504 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:59.084259 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-39ba27a5-c119-4fa3-ac48-36b6a54c0504 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:29:59.084747 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-39ba27a5-c119-4fa3-ac48-36b6a54c0504 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:29:59.085176 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-39ba27a5-c119-4fa3-ac48-36b6a54c0504 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:29:59.219227 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-39ba27a5-c119-4fa3-ac48-36b6a54c0504 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:59.228224 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-39ba27a5-c119-4fa3-ac48-36b6a54c0504 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:59.229665 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-39ba27a5-c119-4fa3-ac48-36b6a54c0504 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:29:59.231038 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-39ba27a5-c119-4fa3-ac48-36b6a54c0504 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1729 microversion: 2.20 time: 0.163876 Sep 21 12:29:59.231597 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 443/872] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:29:59 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:30:00.270396 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-8fe81a2c-d4f7-4106-94bf-525f83cf1dc5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:30:00.271055 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-8fe81a2c-d4f7-4106-94bf-525f83cf1dc5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:30:00.277801 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8fe81a2c-d4f7-4106-94bf-525f83cf1dc5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:00.278282 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8fe81a2c-d4f7-4106-94bf-525f83cf1dc5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:00.278719 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8fe81a2c-d4f7-4106-94bf-525f83cf1dc5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:00.279423 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8fe81a2c-d4f7-4106-94bf-525f83cf1dc5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:00.279888 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8fe81a2c-d4f7-4106-94bf-525f83cf1dc5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:00.280322 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8fe81a2c-d4f7-4106-94bf-525f83cf1dc5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:00.411738 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-8fe81a2c-d4f7-4106-94bf-525f83cf1dc5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:30:00.420629 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-8fe81a2c-d4f7-4106-94bf-525f83cf1dc5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:30:00.422076 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-8fe81a2c-d4f7-4106-94bf-525f83cf1dc5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:30:00.423228 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-8fe81a2c-d4f7-4106-94bf-525f83cf1dc5 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1729 microversion: 2.20 time: 0.156846 Sep 21 12:30:00.423822 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 444/873] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:30:00 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:30:01.449228 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-1f0101ea-8931-4b05-8db4-31f043d85075 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:30:01.449902 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-1f0101ea-8931-4b05-8db4-31f043d85075 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:30:01.456733 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1f0101ea-8931-4b05-8db4-31f043d85075 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:01.457227 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1f0101ea-8931-4b05-8db4-31f043d85075 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:01.457667 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1f0101ea-8931-4b05-8db4-31f043d85075 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:01.458391 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1f0101ea-8931-4b05-8db4-31f043d85075 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:01.458855 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1f0101ea-8931-4b05-8db4-31f043d85075 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:01.459283 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1f0101ea-8931-4b05-8db4-31f043d85075 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:01.606127 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-1f0101ea-8931-4b05-8db4-31f043d85075 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:30:01.614839 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-1f0101ea-8931-4b05-8db4-31f043d85075 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:30:01.616318 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-1f0101ea-8931-4b05-8db4-31f043d85075 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:30:01.617510 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-1f0101ea-8931-4b05-8db4-31f043d85075 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1729 microversion: 2.20 time: 0.172785 Sep 21 12:30:01.618085 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 445/874] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:30:01 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:30:02.644289 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-de56572c-da81-4cb4-ba9d-05f6be67a653 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:30:02.644998 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-de56572c-da81-4cb4-ba9d-05f6be67a653 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:30:02.651461 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-de56572c-da81-4cb4-ba9d-05f6be67a653 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:02.651983 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-de56572c-da81-4cb4-ba9d-05f6be67a653 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:02.652424 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-de56572c-da81-4cb4-ba9d-05f6be67a653 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:02.653130 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-de56572c-da81-4cb4-ba9d-05f6be67a653 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:02.653582 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-de56572c-da81-4cb4-ba9d-05f6be67a653 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:02.654007 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-de56572c-da81-4cb4-ba9d-05f6be67a653 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:02.802097 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-de56572c-da81-4cb4-ba9d-05f6be67a653 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:30:02.811279 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-de56572c-da81-4cb4-ba9d-05f6be67a653 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:30:02.812816 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-de56572c-da81-4cb4-ba9d-05f6be67a653 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:30:02.813971 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-de56572c-da81-4cb4-ba9d-05f6be67a653 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1729 microversion: 2.20 time: 0.173705 Sep 21 12:30:02.814535 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 446/875] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:30:02 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:30:03.841016 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-759ca39e-019a-427b-8c15-71596ac06481 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:30:03.841683 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-759ca39e-019a-427b-8c15-71596ac06481 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:30:03.848133 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-759ca39e-019a-427b-8c15-71596ac06481 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:03.848619 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-759ca39e-019a-427b-8c15-71596ac06481 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:03.849059 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-759ca39e-019a-427b-8c15-71596ac06481 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:03.849751 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-759ca39e-019a-427b-8c15-71596ac06481 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:03.850204 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-759ca39e-019a-427b-8c15-71596ac06481 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:03.850627 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-759ca39e-019a-427b-8c15-71596ac06481 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:03.977344 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-759ca39e-019a-427b-8c15-71596ac06481 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:30:03.985479 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-759ca39e-019a-427b-8c15-71596ac06481 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:30:03.986929 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-759ca39e-019a-427b-8c15-71596ac06481 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:30:03.988126 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-759ca39e-019a-427b-8c15-71596ac06481 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1729 microversion: 2.20 time: 0.151714 Sep 21 12:30:03.988689 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 447/876] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:30:03 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:30:05.013801 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-4b3f6662-3f66-47f0-8bd7-09834f967cbb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:30:05.014439 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-4b3f6662-3f66-47f0-8bd7-09834f967cbb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:30:05.021284 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4b3f6662-3f66-47f0-8bd7-09834f967cbb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:05.021752 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4b3f6662-3f66-47f0-8bd7-09834f967cbb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:05.022180 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4b3f6662-3f66-47f0-8bd7-09834f967cbb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:05.022862 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4b3f6662-3f66-47f0-8bd7-09834f967cbb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:05.023310 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4b3f6662-3f66-47f0-8bd7-09834f967cbb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:05.023732 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4b3f6662-3f66-47f0-8bd7-09834f967cbb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:05.212698 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-48b9b431-647f-41bc-a22f-18581edbab20 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "POST /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.099690 Sep 21 12:30:05.215177 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 430/877] 10.222.0.71 () {60 vars in 1323 bytes} [Wed Sep 21 12:29:57 2022] POST /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c/os-volume_attachments => generated 194 bytes in 8103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:30:05.283152 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-4b3f6662-3f66-47f0-8bd7-09834f967cbb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:30:05.291613 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-4b3f6662-3f66-47f0-8bd7-09834f967cbb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:30:05.293107 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-4b3f6662-3f66-47f0-8bd7-09834f967cbb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:30:05.294284 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-4b3f6662-3f66-47f0-8bd7-09834f967cbb tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1729 microversion: 2.20 time: 0.284565 Sep 21 12:30:05.294848 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 448/878] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:30:05 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1729 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:30:06.326912 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-55cd3446-6487-441c-89e9-fc14c92584e1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:30:06.327901 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-55cd3446-6487-441c-89e9-fc14c92584e1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:30:06.336669 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:30:06.340055 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-55cd3446-6487-441c-89e9-fc14c92584e1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:06.340811 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-55cd3446-6487-441c-89e9-fc14c92584e1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:06.342154 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-55cd3446-6487-441c-89e9-fc14c92584e1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:06.343195 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-55cd3446-6487-441c-89e9-fc14c92584e1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:06.343908 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-55cd3446-6487-441c-89e9-fc14c92584e1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:06.344582 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-55cd3446-6487-441c-89e9-fc14c92584e1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:06.497536 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-55cd3446-6487-441c-89e9-fc14c92584e1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:30:06.506191 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-55cd3446-6487-441c-89e9-fc14c92584e1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:30:06.507655 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-55cd3446-6487-441c-89e9-fc14c92584e1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:30:06.508988 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-55cd3446-6487-441c-89e9-fc14c92584e1 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1729 microversion: 2.20 time: 0.192037 Sep 21 12:30:06.509565 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 431/879] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:30:06 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1729 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:30:07.248997 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-97397022-348e-48c6-ab53-873fe015ab06 req-352123aa-4e49-45a1-9ad9-287392345b07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc34c677-0e22-4734-95ed-4a6834d9dc7b", "name": "network-vif-plugged", "status": "completed", "tag": "49e15f4c-39c9-4c9a-bb24-e89e5dcc9eab"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:30:07.261108 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-97397022-348e-48c6-ab53-873fe015ab06 req-352123aa-4e49-45a1-9ad9-287392345b07 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:07.261600 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-97397022-348e-48c6-ab53-873fe015ab06 req-352123aa-4e49-45a1-9ad9-287392345b07 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:07.262325 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-97397022-348e-48c6-ab53-873fe015ab06 req-352123aa-4e49-45a1-9ad9-287392345b07 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:07.273790 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-97397022-348e-48c6-ab53-873fe015ab06 req-352123aa-4e49-45a1-9ad9-287392345b07 service nova] Creating event network-vif-plugged:49e15f4c-39c9-4c9a-bb24-e89e5dcc9eab for instance dc34c677-0e22-4734-95ed-4a6834d9dc7b on hv-cinder-85867 Sep 21 12:30:07.278836 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-97397022-348e-48c6-ab53-873fe015ab06 req-352123aa-4e49-45a1-9ad9-287392345b07 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034146 Sep 21 12:30:07.282803 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 449/880] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:30:07.535185 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-abadd927-4796-4ca7-aa57-95b094e8355e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:30:07.536225 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-abadd927-4796-4ca7-aa57-95b094e8355e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:30:07.542998 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-abadd927-4796-4ca7-aa57-95b094e8355e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:07.543485 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-abadd927-4796-4ca7-aa57-95b094e8355e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:07.543957 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-abadd927-4796-4ca7-aa57-95b094e8355e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:07.544666 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-abadd927-4796-4ca7-aa57-95b094e8355e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:07.545122 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-abadd927-4796-4ca7-aa57-95b094e8355e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:07.545554 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-abadd927-4796-4ca7-aa57-95b094e8355e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:07.677828 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-abadd927-4796-4ca7-aa57-95b094e8355e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:30:07.686950 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-abadd927-4796-4ca7-aa57-95b094e8355e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:30:07.688503 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-abadd927-4796-4ca7-aa57-95b094e8355e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:30:07.690348 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-abadd927-4796-4ca7-aa57-95b094e8355e tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1729 microversion: 2.20 time: 0.159720 Sep 21 12:30:07.690923 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 432/881] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:30:07 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:30:08.717216 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-1f69c923-5616-48e6-ad26-49cfaf25d676 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:30:08.717825 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-1f69c923-5616-48e6-ad26-49cfaf25d676 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:30:08.723945 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1f69c923-5616-48e6-ad26-49cfaf25d676 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:08.724428 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1f69c923-5616-48e6-ad26-49cfaf25d676 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:08.724862 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1f69c923-5616-48e6-ad26-49cfaf25d676 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:08.725544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1f69c923-5616-48e6-ad26-49cfaf25d676 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:08.725996 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1f69c923-5616-48e6-ad26-49cfaf25d676 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:08.726420 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1f69c923-5616-48e6-ad26-49cfaf25d676 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:08.862430 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-1f69c923-5616-48e6-ad26-49cfaf25d676 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:30:08.871395 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-1f69c923-5616-48e6-ad26-49cfaf25d676 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:30:08.872885 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-1f69c923-5616-48e6-ad26-49cfaf25d676 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:30:08.874049 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-1f69c923-5616-48e6-ad26-49cfaf25d676 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1729 microversion: 2.20 time: 0.161706 Sep 21 12:30:08.874618 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 450/882] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:30:08 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:30:09.899049 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-c0808c37-cf2b-49ea-a41d-ff3dc350bf67 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:30:09.899679 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-c0808c37-cf2b-49ea-a41d-ff3dc350bf67 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:30:09.907187 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0808c37-cf2b-49ea-a41d-ff3dc350bf67 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:09.907686 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0808c37-cf2b-49ea-a41d-ff3dc350bf67 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:09.908166 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0808c37-cf2b-49ea-a41d-ff3dc350bf67 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:09.908878 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0808c37-cf2b-49ea-a41d-ff3dc350bf67 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:09.909450 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0808c37-cf2b-49ea-a41d-ff3dc350bf67 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:09.909775 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0808c37-cf2b-49ea-a41d-ff3dc350bf67 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:10.060895 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-c0808c37-cf2b-49ea-a41d-ff3dc350bf67 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:30:10.070929 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-c0808c37-cf2b-49ea-a41d-ff3dc350bf67 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:30:10.073711 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-c0808c37-cf2b-49ea-a41d-ff3dc350bf67 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:30:10.075158 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-c0808c37-cf2b-49ea-a41d-ff3dc350bf67 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1729 microversion: 2.20 time: 0.180160 Sep 21 12:30:10.076493 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 433/883] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:30:09 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:30:11.101324 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-616f6ef1-2459-4a09-ae7f-7a74d354d971 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:30:11.102062 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-616f6ef1-2459-4a09-ae7f-7a74d354d971 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:30:11.109286 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-616f6ef1-2459-4a09-ae7f-7a74d354d971 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:11.109774 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-616f6ef1-2459-4a09-ae7f-7a74d354d971 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:11.110216 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-616f6ef1-2459-4a09-ae7f-7a74d354d971 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:11.110914 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-616f6ef1-2459-4a09-ae7f-7a74d354d971 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:11.111563 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-616f6ef1-2459-4a09-ae7f-7a74d354d971 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:11.112020 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-616f6ef1-2459-4a09-ae7f-7a74d354d971 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:11.246733 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-616f6ef1-2459-4a09-ae7f-7a74d354d971 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:30:11.262126 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-616f6ef1-2459-4a09-ae7f-7a74d354d971 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:30:11.265351 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-616f6ef1-2459-4a09-ae7f-7a74d354d971 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:30:11.267529 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-616f6ef1-2459-4a09-ae7f-7a74d354d971 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1716 microversion: 2.20 time: 0.170031 Sep 21 12:30:11.268578 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 451/884] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:30:11 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1716 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:30:12.825207 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-8f7f02c9-bbf3-4078-861e-f2a5797d29a8 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:30:12.827457 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-8f7f02c9-bbf3-4078-861e-f2a5797d29a8 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:30:12.834657 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8f7f02c9-bbf3-4078-861e-f2a5797d29a8 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:12.835142 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8f7f02c9-bbf3-4078-861e-f2a5797d29a8 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:12.835583 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8f7f02c9-bbf3-4078-861e-f2a5797d29a8 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:12.836411 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8f7f02c9-bbf3-4078-861e-f2a5797d29a8 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:12.836753 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8f7f02c9-bbf3-4078-861e-f2a5797d29a8 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:12.837178 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8f7f02c9-bbf3-4078-861e-f2a5797d29a8 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:12.867467 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-8f7f02c9-bbf3-4078-861e-f2a5797d29a8 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046391 Sep 21 12:30:12.868079 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 434/885] 10.222.0.71 () {58 vars in 1302 bytes} [Wed Sep 21 12:30:12 2022] GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:30:12.879688 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-b349f9a8-bc76-4747-a292-b43c7f50c6d4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:30:12.880270 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-b349f9a8-bc76-4747-a292-b43c7f50c6d4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:30:12.886972 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b349f9a8-bc76-4747-a292-b43c7f50c6d4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:12.887466 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b349f9a8-bc76-4747-a292-b43c7f50c6d4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:12.887940 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b349f9a8-bc76-4747-a292-b43c7f50c6d4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:12.888657 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b349f9a8-bc76-4747-a292-b43c7f50c6d4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:12.889118 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b349f9a8-bc76-4747-a292-b43c7f50c6d4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:12.889547 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b349f9a8-bc76-4747-a292-b43c7f50c6d4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:12.920008 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-b349f9a8-bc76-4747-a292-b43c7f50c6d4 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c/os-volume_attachments/4d6545e7-490c-4990-a7db-9df50eee202b" status: 200 len: 194 microversion: 2.1 time: 0.044338 Sep 21 12:30:12.920627 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 452/886] 10.222.0.71 () {58 vars in 1413 bytes} [Wed Sep 21 12:30:12 2022] GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c/os-volume_attachments/4d6545e7-490c-4990-a7db-9df50eee202b => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:30:14.257696 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-09c645a3-ee4c-44fa-bc0f-84cb8288534b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fecd4c2d-a9c3-4922-bd6b-928f8bd609ec"}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:30:14.260118 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-09c645a3-ee4c-44fa-bc0f-84cb8288534b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:30:14.266944 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-09c645a3-ee4c-44fa-bc0f-84cb8288534b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:14.267982 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-09c645a3-ee4c-44fa-bc0f-84cb8288534b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:14.268394 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-09c645a3-ee4c-44fa-bc0f-84cb8288534b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:14.269114 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-09c645a3-ee4c-44fa-bc0f-84cb8288534b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:14.269574 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-09c645a3-ee4c-44fa-bc0f-84cb8288534b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:14.270007 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-09c645a3-ee4c-44fa-bc0f-84cb8288534b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:14.541890 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-09c645a3-ee4c-44fa-bc0f-84cb8288534b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "POST /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287250 Sep 21 12:30:14.542514 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 435/887] 10.222.0.71 () {60 vars in 1323 bytes} [Wed Sep 21 12:30:14 2022] POST /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:30:22.085013 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-416db85d-9b0e-414d-9a7f-31f7b94dcef6 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:30:22.087140 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-416db85d-9b0e-414d-9a7f-31f7b94dcef6 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:30:22.090210 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_api:SELECT=40 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:30:22.095739 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-416db85d-9b0e-414d-9a7f-31f7b94dcef6 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:22.096259 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-416db85d-9b0e-414d-9a7f-31f7b94dcef6 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:22.096693 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-416db85d-9b0e-414d-9a7f-31f7b94dcef6 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:22.097383 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-416db85d-9b0e-414d-9a7f-31f7b94dcef6 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:22.097839 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-416db85d-9b0e-414d-9a7f-31f7b94dcef6 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:22.098271 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-416db85d-9b0e-414d-9a7f-31f7b94dcef6 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:22.128281 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-416db85d-9b0e-414d-9a7f-31f7b94dcef6 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047059 Sep 21 12:30:22.128756 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 453/888] 10.222.0.71 () {58 vars in 1302 bytes} [Wed Sep 21 12:30:22 2022] GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:30:22.269834 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-1524b39c-8e21-499c-ba62-ca713a428269 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:30:22.270456 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-1524b39c-8e21-499c-ba62-ca713a428269 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:30:22.277194 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1524b39c-8e21-499c-ba62-ca713a428269 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:22.277680 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1524b39c-8e21-499c-ba62-ca713a428269 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:22.278121 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1524b39c-8e21-499c-ba62-ca713a428269 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:22.278813 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1524b39c-8e21-499c-ba62-ca713a428269 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:22.279272 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1524b39c-8e21-499c-ba62-ca713a428269 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:22.279700 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1524b39c-8e21-499c-ba62-ca713a428269 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:22.308865 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-1524b39c-8e21-499c-ba62-ca713a428269 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c/os-volume_attachments/4d6545e7-490c-4990-a7db-9df50eee202b" status: 200 len: 194 microversion: 2.1 time: 0.043967 Sep 21 12:30:22.309455 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 436/889] 10.222.0.71 () {58 vars in 1413 bytes} [Wed Sep 21 12:30:22 2022] GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c/os-volume_attachments/4d6545e7-490c-4990-a7db-9df50eee202b => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:30:22.320281 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-19ebe0ff-e75b-4457-ac85-7ddeb2d8f5f0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:30:22.320837 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-19ebe0ff-e75b-4457-ac85-7ddeb2d8f5f0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:30:22.328671 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-19ebe0ff-e75b-4457-ac85-7ddeb2d8f5f0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:22.329175 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-19ebe0ff-e75b-4457-ac85-7ddeb2d8f5f0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:22.329620 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-19ebe0ff-e75b-4457-ac85-7ddeb2d8f5f0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:22.330843 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-19ebe0ff-e75b-4457-ac85-7ddeb2d8f5f0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:22.331306 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-19ebe0ff-e75b-4457-ac85-7ddeb2d8f5f0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:22.331744 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-19ebe0ff-e75b-4457-ac85-7ddeb2d8f5f0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:22.415568 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.objects.instance [None req-19ebe0ff-e75b-4457-ac85-7ddeb2d8f5f0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lazy-loading 'services' on Instance uuid f60cc06f-a959-4872-9552-99d76b9f4c7c {{(pid=120462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 12:30:22.487681 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-19ebe0ff-e75b-4457-ac85-7ddeb2d8f5f0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "DELETE /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c/os-volume_attachments/4d6545e7-490c-4990-a7db-9df50eee202b" status: 202 len: 0 microversion: 2.1 time: 0.171281 Sep 21 12:30:22.488313 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 454/890] 10.222.0.71 () {58 vars in 1416 bytes} [Wed Sep 21 12:30:22 2022] DELETE /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c/os-volume_attachments/4d6545e7-490c-4990-a7db-9df50eee202b => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 12:30:24.672615 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-9fc02ca1-a300-44b4-9651-fafc04443f14 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:30:24.673142 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-9fc02ca1-a300-44b4-9651-fafc04443f14 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:30:24.679508 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9fc02ca1-a300-44b4-9651-fafc04443f14 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:24.680041 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9fc02ca1-a300-44b4-9651-fafc04443f14 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:24.680486 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9fc02ca1-a300-44b4-9651-fafc04443f14 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:24.681196 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9fc02ca1-a300-44b4-9651-fafc04443f14 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:24.681694 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9fc02ca1-a300-44b4-9651-fafc04443f14 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:24.682780 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9fc02ca1-a300-44b4-9651-fafc04443f14 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:24.686527 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:30:24.713372 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-9fc02ca1-a300-44b4-9651-fafc04443f14 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c/os-volume_attachments/fecd4c2d-a9c3-4922-bd6b-928f8bd609ec" status: 200 len: 194 microversion: 2.1 time: 0.044680 Sep 21 12:30:24.713973 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 437/891] 10.222.0.71 () {58 vars in 1413 bytes} [Wed Sep 21 12:30:24 2022] GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c/os-volume_attachments/fecd4c2d-a9c3-4922-bd6b-928f8bd609ec => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 12:30:24.725523 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-8a04dd68-dfeb-4150-9bac-66517d6fa5ea tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:30:24.726109 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-8a04dd68-dfeb-4150-9bac-66517d6fa5ea tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:30:24.732794 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8a04dd68-dfeb-4150-9bac-66517d6fa5ea tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:24.733281 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8a04dd68-dfeb-4150-9bac-66517d6fa5ea tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:24.733726 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8a04dd68-dfeb-4150-9bac-66517d6fa5ea tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:24.734426 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8a04dd68-dfeb-4150-9bac-66517d6fa5ea tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:24.734886 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8a04dd68-dfeb-4150-9bac-66517d6fa5ea tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:24.735317 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8a04dd68-dfeb-4150-9bac-66517d6fa5ea tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:24.815302 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.objects.instance [None req-8a04dd68-dfeb-4150-9bac-66517d6fa5ea tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lazy-loading 'services' on Instance uuid f60cc06f-a959-4872-9552-99d76b9f4c7c {{(pid=120462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 12:30:24.890571 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-8a04dd68-dfeb-4150-9bac-66517d6fa5ea tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "DELETE /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c/os-volume_attachments/fecd4c2d-a9c3-4922-bd6b-928f8bd609ec" status: 202 len: 0 microversion: 2.1 time: 0.169648 Sep 21 12:30:24.891172 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 455/892] 10.222.0.71 () {58 vars in 1416 bytes} [Wed Sep 21 12:30:24 2022] DELETE /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c/os-volume_attachments/fecd4c2d-a9c3-4922-bd6b-928f8bd609ec => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 12:30:26.070577 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-a2827722-9cb3-4af3-91d8-7c3c738128d0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:30:26.073701 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-a2827722-9cb3-4af3-91d8-7c3c738128d0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:30:26.080088 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a2827722-9cb3-4af3-91d8-7c3c738128d0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:26.080582 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a2827722-9cb3-4af3-91d8-7c3c738128d0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:26.081036 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a2827722-9cb3-4af3-91d8-7c3c738128d0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:26.081735 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a2827722-9cb3-4af3-91d8-7c3c738128d0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:26.082199 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a2827722-9cb3-4af3-91d8-7c3c738128d0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:26.082634 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a2827722-9cb3-4af3-91d8-7c3c738128d0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:26.114607 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-a2827722-9cb3-4af3-91d8-7c3c738128d0 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047869 Sep 21 12:30:26.115091 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 438/893] 10.222.0.71 () {58 vars in 1302 bytes} [Wed Sep 21 12:30:26 2022] GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 21 12:30:26.235275 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-1b3e2809-e559-482a-9adc-199092386a40 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:30:26.237945 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-1b3e2809-e559-482a-9adc-199092386a40 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:30:26.244338 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1b3e2809-e559-482a-9adc-199092386a40 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:26.244860 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1b3e2809-e559-482a-9adc-199092386a40 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:26.245300 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1b3e2809-e559-482a-9adc-199092386a40 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:26.245996 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1b3e2809-e559-482a-9adc-199092386a40 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:26.246487 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1b3e2809-e559-482a-9adc-199092386a40 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:26.247117 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1b3e2809-e559-482a-9adc-199092386a40 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:26.276535 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-1b3e2809-e559-482a-9adc-199092386a40 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044879 Sep 21 12:30:26.277097 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 456/894] 10.222.0.71 () {58 vars in 1302 bytes} [Wed Sep 21 12:30:26 2022] GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 21 12:30:26.341054 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-d1d83f8f-57e8-46a6-b42f-dc51792a2baf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:30:26.341557 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-d1d83f8f-57e8-46a6-b42f-dc51792a2baf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:30:26.347629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d1d83f8f-57e8-46a6-b42f-dc51792a2baf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:26.348154 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d1d83f8f-57e8-46a6-b42f-dc51792a2baf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:26.348594 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d1d83f8f-57e8-46a6-b42f-dc51792a2baf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:26.349290 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d1d83f8f-57e8-46a6-b42f-dc51792a2baf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:26.349750 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d1d83f8f-57e8-46a6-b42f-dc51792a2baf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:26.350182 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d1d83f8f-57e8-46a6-b42f-dc51792a2baf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:26.374767 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-d1d83f8f-57e8-46a6-b42f-dc51792a2baf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Going to try to terminate instance {{(pid=120463) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 12:30:26.453005 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-d1d83f8f-57e8-46a6-b42f-dc51792a2baf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "DELETE /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c" status: 204 len: 0 microversion: 2.1 time: 0.116057 Sep 21 12:30:26.453649 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 439/895] 10.222.0.71 () {58 vars in 1239 bytes} [Wed Sep 21 12:30:26 2022] DELETE /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 21 12:30:26.462012 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-78d54b1d-24f1-4079-a526-56f2e409321c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:30:26.462630 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-78d54b1d-24f1-4079-a526-56f2e409321c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:30:26.469331 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-78d54b1d-24f1-4079-a526-56f2e409321c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:26.469815 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-78d54b1d-24f1-4079-a526-56f2e409321c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:26.470311 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-78d54b1d-24f1-4079-a526-56f2e409321c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:26.471004 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-78d54b1d-24f1-4079-a526-56f2e409321c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:26.471466 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-78d54b1d-24f1-4079-a526-56f2e409321c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:26.471952 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-78d54b1d-24f1-4079-a526-56f2e409321c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:26.600362 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-78d54b1d-24f1-4079-a526-56f2e409321c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:30:26.602687 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:30:26.609994 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-78d54b1d-24f1-4079-a526-56f2e409321c tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c" status: 200 len: 1674 microversion: 2.1 time: 0.151868 Sep 21 12:30:26.610572 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 457/896] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:30:26 2022] GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:30:27.633846 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-5837d8bb-bb74-46ec-9b3d-28dd7775fd60 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:30:27.634626 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-5837d8bb-bb74-46ec-9b3d-28dd7775fd60 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:30:27.642614 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5837d8bb-bb74-46ec-9b3d-28dd7775fd60 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:27.643112 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5837d8bb-bb74-46ec-9b3d-28dd7775fd60 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:27.643554 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5837d8bb-bb74-46ec-9b3d-28dd7775fd60 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:27.644332 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5837d8bb-bb74-46ec-9b3d-28dd7775fd60 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:27.644831 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5837d8bb-bb74-46ec-9b3d-28dd7775fd60 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:27.645230 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5837d8bb-bb74-46ec-9b3d-28dd7775fd60 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:27.780793 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-5837d8bb-bb74-46ec-9b3d-28dd7775fd60 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:30:27.788868 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-5837d8bb-bb74-46ec-9b3d-28dd7775fd60 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c" status: 200 len: 1674 microversion: 2.1 time: 0.159593 Sep 21 12:30:27.789439 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 440/897] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:30:27 2022] GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:30:28.813353 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-0e8e2cd3-df7d-4848-9f94-6df632c9c12b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:30:28.813893 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-0e8e2cd3-df7d-4848-9f94-6df632c9c12b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:30:28.821430 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0e8e2cd3-df7d-4848-9f94-6df632c9c12b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:28.821932 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0e8e2cd3-df7d-4848-9f94-6df632c9c12b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:28.823185 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0e8e2cd3-df7d-4848-9f94-6df632c9c12b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:28.823942 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0e8e2cd3-df7d-4848-9f94-6df632c9c12b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:28.824407 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0e8e2cd3-df7d-4848-9f94-6df632c9c12b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:28.824842 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0e8e2cd3-df7d-4848-9f94-6df632c9c12b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:29.077785 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-0e8e2cd3-df7d-4848-9f94-6df632c9c12b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:30:29.087733 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-0e8e2cd3-df7d-4848-9f94-6df632c9c12b tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c" status: 200 len: 1674 microversion: 2.1 time: 0.278349 Sep 21 12:30:29.088690 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 458/898] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:30:28 2022] GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c => generated 1674 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:30:29.772099 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-d3053019-c1ce-4938-b9f0-e147b4a6e211 req-54f7257a-af54-414a-951a-b09f5cb9b595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f60cc06f-a959-4872-9552-99d76b9f4c7c", "name": "network-vif-deleted", "tag": "621b6d40-2773-4228-966f-8aedb5d52908"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:30:29.788157 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-d3053019-c1ce-4938-b9f0-e147b4a6e211 req-54f7257a-af54-414a-951a-b09f5cb9b595 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:29.788677 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-d3053019-c1ce-4938-b9f0-e147b4a6e211 req-54f7257a-af54-414a-951a-b09f5cb9b595 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:29.789126 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-d3053019-c1ce-4938-b9f0-e147b4a6e211 req-54f7257a-af54-414a-951a-b09f5cb9b595 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:29.813565 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-d3053019-c1ce-4938-b9f0-e147b4a6e211 req-54f7257a-af54-414a-951a-b09f5cb9b595 service nova] Creating event network-vif-deleted:621b6d40-2773-4228-966f-8aedb5d52908 for instance f60cc06f-a959-4872-9552-99d76b9f4c7c on hv-cinder-85867 Sep 21 12:30:29.818569 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-d3053019-c1ce-4938-b9f0-e147b4a6e211 req-54f7257a-af54-414a-951a-b09f5cb9b595 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055117 Sep 21 12:30:29.819939 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 441/899] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:30:30.113413 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-7a98c149-1f3b-4060-a383-f7651eeb240f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:30:30.115200 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-7a98c149-1f3b-4060-a383-f7651eeb240f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:30:30.123018 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7a98c149-1f3b-4060-a383-f7651eeb240f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:30.123515 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7a98c149-1f3b-4060-a383-f7651eeb240f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:30.124142 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7a98c149-1f3b-4060-a383-f7651eeb240f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:30.124747 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7a98c149-1f3b-4060-a383-f7651eeb240f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:30.125205 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7a98c149-1f3b-4060-a383-f7651eeb240f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:30.125643 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7a98c149-1f3b-4060-a383-f7651eeb240f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:30.169419 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7a98c149-1f3b-4060-a383-f7651eeb240f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:30.170037 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7a98c149-1f3b-4060-a383-f7651eeb240f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:30.170764 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7a98c149-1f3b-4060-a383-f7651eeb240f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:30.171604 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.objects.instance [None req-7a98c149-1f3b-4060-a383-f7651eeb240f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lazy-loading 'fault' on Instance uuid f60cc06f-a959-4872-9552-99d76b9f4c7c {{(pid=120462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 12:30:30.218958 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-7a98c149-1f3b-4060-a383-f7651eeb240f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8790c086dcaa4da5b739bcd02d30b4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9340222cfe154efe8a6064b197d54499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:30:30.228100 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-7a98c149-1f3b-4060-a383-f7651eeb240f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c" status: 200 len: 1328 microversion: 2.1 time: 0.118953 Sep 21 12:30:30.229788 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 459/900] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:30:30 2022] GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c => generated 1328 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:30:31.253679 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-c17cfded-db5a-42aa-84e1-bd353ce056b1 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:30:31.254385 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-c17cfded-db5a-42aa-84e1-bd353ce056b1 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:30:31.261361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c17cfded-db5a-42aa-84e1-bd353ce056b1 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:31.261902 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c17cfded-db5a-42aa-84e1-bd353ce056b1 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:31.262304 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c17cfded-db5a-42aa-84e1-bd353ce056b1 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:31.263004 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c17cfded-db5a-42aa-84e1-bd353ce056b1 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:31.263461 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c17cfded-db5a-42aa-84e1-bd353ce056b1 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:31.264171 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c17cfded-db5a-42aa-84e1-bd353ce056b1 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:31.279348 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.wsgi [None req-c17cfded-db5a-42aa-84e1-bd353ce056b1 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] HTTP exception thrown: Instance f60cc06f-a959-4872-9552-99d76b9f4c7c could not be found. Sep 21 12:30:31.281046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-c17cfded-db5a-42aa-84e1-bd353ce056b1 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Request method failure captured: Sep 21 12:30:31.281046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: request: GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c HTTP/1.1 Sep 21 12:30:31.281046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept: application/json Sep 21 12:30:31.281046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept-Encoding: identity Sep 21 12:30:31.281046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Connection: close Sep 21 12:30:31.281046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Length: 0 Sep 21 12:30:31.281046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Type: application/json Sep 21 12:30:31.281046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Host: 10.222.0.71 Sep 21 12:30:31.281046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Openstack-System-Scope: None Sep 21 12:30:31.281046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: User-Agent: python-urllib3/1.26.12 Sep 21 12:30:31.281046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Auth-Token: gAAAAABjKwGp0KjgM_ndjptxwLGhVApHaQzyngoX69SpmnL3OTWtuoH75cPAz9ySdKN9ANQ84Gpscfvltf8W5ER92YP4kr_u_TD1VCoJF2B1xO3RAGirJWPKEvwdA77dha7dIk8YIqrPVzLb-I5bTZ5zfnCJbSYJGEE0BnyXPMZsLyIt9WY4RPs Sep 21 12:30:31.281046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Id: None Sep 21 12:30:31.281046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Name: None Sep 21 12:30:31.281046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Identity-Status: Confirmed Sep 21 12:30:31.281046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Is-Admin-Project: True Sep 21 12:30:31.281046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Id: default Sep 21 12:30:31.281046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Name: Default Sep 21 12:30:31.281046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Id: 9340222cfe154efe8a6064b197d54499 Sep 21 12:30:31.281046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Name: tempest-AttachVolumeTestJSON-1528768827 Sep 21 12:30:31.281046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Role: reader,member Sep 21 12:30:31.281046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Roles: reader,member Sep 21 12:30:31.282673 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9340222cfe154efe8a6064b197d54499"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9340222cfe154efe8a6064b197d54499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_9340222cfe154efe8a6064b197d54499", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/9340222cfe154efe8a6064b197d54499"}]}] Sep 21 12:30:31.282673 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant: tempest-AttachVolumeTestJSON-1528768827 Sep 21 12:30:31.282673 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Id: 9340222cfe154efe8a6064b197d54499 Sep 21 12:30:31.282673 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1528768827 Sep 21 12:30:31.282673 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User: tempest-AttachVolumeTestJSON-1528768827-project Sep 21 12:30:31.282673 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Id: default Sep 21 12:30:31.282673 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Name: Default Sep 21 12:30:31.282673 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Id: 8790c086dcaa4da5b739bcd02d30b4c0 Sep 21 12:30:31.282673 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Name: tempest-AttachVolumeTestJSON-1528768827-project Sep 21 12:30:31.282673 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: method: > Sep 21 12:30:31.282673 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: exception: Instance f60cc06f-a959-4872-9552-99d76b9f4c7c could not be found. Sep 21 12:30:31.282673 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: action_args: {'id': 'f60cc06f-a959-4872-9552-99d76b9f4c7c'} Sep 21 12:30:31.283507 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:30:31.283507 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:30:31.283507 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:30:31.283507 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:30:31.283507 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:30:31.283507 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:30:31.283507 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:30:31.283507 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:30:31.283507 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:30:31.283507 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:30:31.283507 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f60cc06f-a959-4872-9552-99d76b9f4c7c could not be found. Sep 21 12:30:31.283507 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:30:31.283507 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:30:31.283507 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:30:31.283507 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:30:31.283507 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:30:31.283507 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:30:31.283507 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:30:31.283507 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:30:31.283507 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:30:31.284850 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:30:31.284850 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 12:30:31.284850 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 12:30:31.284850 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:30:31.284850 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:30:31.284850 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:30:31.284850 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:30:31.284850 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f60cc06f-a959-4872-9552-99d76b9f4c7c could not be found. Sep 21 12:30:31.284850 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:30:31.284850 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:30:31.284850 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:30:31.284850 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:30:31.284850 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:30:31.284850 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:30:31.284850 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:30:31.284850 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:30:31.284850 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f60cc06f-a959-4872-9552-99d76b9f4c7c could not be found. Sep 21 12:30:31.284850 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:30:31.286052 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-c17cfded-db5a-42aa-84e1-bd353ce056b1 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Returning 404 to user: Instance f60cc06f-a959-4872-9552-99d76b9f4c7c could not be found. {{(pid=120463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:30:31.286052 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-c17cfded-db5a-42aa-84e1-bd353ce056b1 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c" status: 404 len: 111 microversion: 2.1 time: 0.033571 Sep 21 12:30:31.286052 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 442/901] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:30:31 2022] GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:30:31.291544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-ae361aa0-25be-4fa7-bd93-e439e06e8465 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '.version_select at 0x7fe4cc70e1f0>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:30:31.297087 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ae361aa0-25be-4fa7-bd93-e439e06e8465 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [cfaf2f38-233c-44fd-b6de-37696c6073a3] AMQP server on 10.222.0.71:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 21 12:30:32.304344 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO oslo.messaging._drivers.impl_rabbit [None req-ae361aa0-25be-4fa7-bd93-e439e06e8465 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [cfaf2f38-233c-44fd-b6de-37696c6073a3] Reconnected to AMQP server on 10.222.0.71:5672 via [amqp] client with port 43764. Sep 21 12:30:32.325456 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-ae361aa0-25be-4fa7-bd93-e439e06e8465 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1693007900" status: 202 len: 0 microversion: 2.1 time: 1.037680 Sep 21 12:30:32.326161 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 460/902] 10.222.0.71 () {58 vars in 1221 bytes} [Wed Sep 21 12:30:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1693007900 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 12:30:35.257936 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-d394e213-e8a3-4cb1-a070-be77666b4b3f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:30:35.258448 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-d394e213-e8a3-4cb1-a070-be77666b4b3f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:30:35.265729 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d394e213-e8a3-4cb1-a070-be77666b4b3f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:35.266557 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d394e213-e8a3-4cb1-a070-be77666b4b3f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:35.267015 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d394e213-e8a3-4cb1-a070-be77666b4b3f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:35.267726 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d394e213-e8a3-4cb1-a070-be77666b4b3f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:35.268224 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d394e213-e8a3-4cb1-a070-be77666b4b3f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:35.268661 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d394e213-e8a3-4cb1-a070-be77666b4b3f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:35.282232 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.wsgi [None req-d394e213-e8a3-4cb1-a070-be77666b4b3f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] HTTP exception thrown: Instance f60cc06f-a959-4872-9552-99d76b9f4c7c could not be found. Sep 21 12:30:35.283821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-d394e213-e8a3-4cb1-a070-be77666b4b3f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Request method failure captured: Sep 21 12:30:35.283821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: request: DELETE /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c HTTP/1.1 Sep 21 12:30:35.283821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept: application/json Sep 21 12:30:35.283821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept-Encoding: identity Sep 21 12:30:35.283821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Connection: close Sep 21 12:30:35.283821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Length: 0 Sep 21 12:30:35.283821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Type: application/json Sep 21 12:30:35.283821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Host: 10.222.0.71 Sep 21 12:30:35.283821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Openstack-System-Scope: None Sep 21 12:30:35.283821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: User-Agent: python-urllib3/1.26.12 Sep 21 12:30:35.283821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Auth-Token: gAAAAABjKwGp0KjgM_ndjptxwLGhVApHaQzyngoX69SpmnL3OTWtuoH75cPAz9ySdKN9ANQ84Gpscfvltf8W5ER92YP4kr_u_TD1VCoJF2B1xO3RAGirJWPKEvwdA77dha7dIk8YIqrPVzLb-I5bTZ5zfnCJbSYJGEE0BnyXPMZsLyIt9WY4RPs Sep 21 12:30:35.283821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Id: None Sep 21 12:30:35.283821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Name: None Sep 21 12:30:35.283821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Identity-Status: Confirmed Sep 21 12:30:35.283821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Is-Admin-Project: True Sep 21 12:30:35.283821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Id: default Sep 21 12:30:35.283821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Name: Default Sep 21 12:30:35.283821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Id: 9340222cfe154efe8a6064b197d54499 Sep 21 12:30:35.283821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Name: tempest-AttachVolumeTestJSON-1528768827 Sep 21 12:30:35.283821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Role: reader,member Sep 21 12:30:35.283821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Roles: reader,member Sep 21 12:30:35.285395 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9340222cfe154efe8a6064b197d54499"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9340222cfe154efe8a6064b197d54499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_9340222cfe154efe8a6064b197d54499", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/9340222cfe154efe8a6064b197d54499"}]}] Sep 21 12:30:35.285395 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant: tempest-AttachVolumeTestJSON-1528768827 Sep 21 12:30:35.285395 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Id: 9340222cfe154efe8a6064b197d54499 Sep 21 12:30:35.285395 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1528768827 Sep 21 12:30:35.285395 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User: tempest-AttachVolumeTestJSON-1528768827-project Sep 21 12:30:35.285395 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Id: default Sep 21 12:30:35.285395 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Name: Default Sep 21 12:30:35.285395 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Id: 8790c086dcaa4da5b739bcd02d30b4c0 Sep 21 12:30:35.285395 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Name: tempest-AttachVolumeTestJSON-1528768827-project Sep 21 12:30:35.285395 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: method: > Sep 21 12:30:35.285395 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: exception: Instance f60cc06f-a959-4872-9552-99d76b9f4c7c could not be found. Sep 21 12:30:35.285395 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: action_args: {'id': 'f60cc06f-a959-4872-9552-99d76b9f4c7c'} Sep 21 12:30:35.286350 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:30:35.286350 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:30:35.286350 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:30:35.286350 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:30:35.286350 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:30:35.286350 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:30:35.286350 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:30:35.286350 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:30:35.286350 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:30:35.286350 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:30:35.286350 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f60cc06f-a959-4872-9552-99d76b9f4c7c could not be found. Sep 21 12:30:35.286350 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:30:35.286350 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:30:35.286350 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:30:35.286350 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:30:35.286350 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:30:35.286350 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:30:35.286350 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:30:35.286350 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:30:35.286350 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:30:35.287744 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:30:35.287744 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 21 12:30:35.287744 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 21 12:30:35.287744 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 21 12:30:35.287744 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 21 12:30:35.287744 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:30:35.287744 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:30:35.287744 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:30:35.287744 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:30:35.287744 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f60cc06f-a959-4872-9552-99d76b9f4c7c could not be found. Sep 21 12:30:35.287744 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:30:35.287744 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:30:35.287744 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:30:35.287744 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:30:35.287744 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:30:35.287744 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:30:35.287744 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:30:35.287744 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:30:35.287744 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f60cc06f-a959-4872-9552-99d76b9f4c7c could not be found. Sep 21 12:30:35.287744 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:30:35.289478 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-d394e213-e8a3-4cb1-a070-be77666b4b3f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Returning 404 to user: Instance f60cc06f-a959-4872-9552-99d76b9f4c7c could not be found. {{(pid=120463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:30:35.289478 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-d394e213-e8a3-4cb1-a070-be77666b4b3f tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "DELETE /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c" status: 404 len: 111 microversion: 2.1 time: 0.031146 Sep 21 12:30:35.289478 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 443/903] 10.222.0.71 () {58 vars in 1239 bytes} [Wed Sep 21 12:30:35 2022] DELETE /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:30:35.295625 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-bc951e13-236c-4b87-96c8-ba76d635f47a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:30:35.296282 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-bc951e13-236c-4b87-96c8-ba76d635f47a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: f60cc06f-a959-4872-9552-99d76b9f4c7c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:30:35.302895 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bc951e13-236c-4b87-96c8-ba76d635f47a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:35.303380 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bc951e13-236c-4b87-96c8-ba76d635f47a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:35.303849 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bc951e13-236c-4b87-96c8-ba76d635f47a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:35.304544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bc951e13-236c-4b87-96c8-ba76d635f47a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:35.305003 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bc951e13-236c-4b87-96c8-ba76d635f47a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:35.305436 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bc951e13-236c-4b87-96c8-ba76d635f47a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:35.318934 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.wsgi [None req-bc951e13-236c-4b87-96c8-ba76d635f47a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] HTTP exception thrown: Instance f60cc06f-a959-4872-9552-99d76b9f4c7c could not be found. Sep 21 12:30:35.320612 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-bc951e13-236c-4b87-96c8-ba76d635f47a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Request method failure captured: Sep 21 12:30:35.320612 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: request: GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c HTTP/1.1 Sep 21 12:30:35.320612 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept: application/json Sep 21 12:30:35.320612 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept-Encoding: identity Sep 21 12:30:35.320612 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Connection: close Sep 21 12:30:35.320612 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Length: 0 Sep 21 12:30:35.320612 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Type: application/json Sep 21 12:30:35.320612 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Host: 10.222.0.71 Sep 21 12:30:35.320612 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Openstack-System-Scope: None Sep 21 12:30:35.320612 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: User-Agent: python-urllib3/1.26.12 Sep 21 12:30:35.320612 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Auth-Token: gAAAAABjKwGp0KjgM_ndjptxwLGhVApHaQzyngoX69SpmnL3OTWtuoH75cPAz9ySdKN9ANQ84Gpscfvltf8W5ER92YP4kr_u_TD1VCoJF2B1xO3RAGirJWPKEvwdA77dha7dIk8YIqrPVzLb-I5bTZ5zfnCJbSYJGEE0BnyXPMZsLyIt9WY4RPs Sep 21 12:30:35.320612 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Id: None Sep 21 12:30:35.320612 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Name: None Sep 21 12:30:35.320612 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Identity-Status: Confirmed Sep 21 12:30:35.320612 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Is-Admin-Project: True Sep 21 12:30:35.320612 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Id: default Sep 21 12:30:35.320612 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Name: Default Sep 21 12:30:35.320612 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Id: 9340222cfe154efe8a6064b197d54499 Sep 21 12:30:35.320612 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Name: tempest-AttachVolumeTestJSON-1528768827 Sep 21 12:30:35.320612 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Role: reader,member Sep 21 12:30:35.320612 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Roles: reader,member Sep 21 12:30:35.322414 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9340222cfe154efe8a6064b197d54499"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9340222cfe154efe8a6064b197d54499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_9340222cfe154efe8a6064b197d54499", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/9340222cfe154efe8a6064b197d54499"}]}] Sep 21 12:30:35.322414 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant: tempest-AttachVolumeTestJSON-1528768827 Sep 21 12:30:35.322414 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Id: 9340222cfe154efe8a6064b197d54499 Sep 21 12:30:35.322414 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1528768827 Sep 21 12:30:35.322414 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User: tempest-AttachVolumeTestJSON-1528768827-project Sep 21 12:30:35.322414 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Id: default Sep 21 12:30:35.322414 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Name: Default Sep 21 12:30:35.322414 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Id: 8790c086dcaa4da5b739bcd02d30b4c0 Sep 21 12:30:35.322414 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Name: tempest-AttachVolumeTestJSON-1528768827-project Sep 21 12:30:35.322414 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: method: > Sep 21 12:30:35.322414 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: exception: Instance f60cc06f-a959-4872-9552-99d76b9f4c7c could not be found. Sep 21 12:30:35.322414 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: action_args: {'id': 'f60cc06f-a959-4872-9552-99d76b9f4c7c'} Sep 21 12:30:35.323400 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:30:35.323400 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:30:35.323400 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:30:35.323400 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:30:35.323400 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:30:35.323400 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:30:35.323400 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:30:35.323400 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:30:35.323400 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:30:35.323400 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:30:35.323400 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f60cc06f-a959-4872-9552-99d76b9f4c7c could not be found. Sep 21 12:30:35.323400 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:30:35.323400 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:30:35.323400 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:30:35.323400 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:30:35.323400 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:30:35.323400 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:30:35.323400 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:30:35.323400 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:30:35.323400 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:30:35.324973 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:30:35.324973 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 12:30:35.324973 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 12:30:35.324973 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:30:35.324973 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:30:35.324973 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:30:35.324973 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:30:35.324973 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f60cc06f-a959-4872-9552-99d76b9f4c7c could not be found. Sep 21 12:30:35.324973 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:30:35.324973 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:30:35.324973 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:30:35.324973 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:30:35.324973 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:30:35.324973 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:30:35.324973 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:30:35.324973 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:30:35.324973 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f60cc06f-a959-4872-9552-99d76b9f4c7c could not be found. Sep 21 12:30:35.324973 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:30:35.326272 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-bc951e13-236c-4b87-96c8-ba76d635f47a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Returning 404 to user: Instance f60cc06f-a959-4872-9552-99d76b9f4c7c could not be found. {{(pid=120462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:30:35.326272 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-bc951e13-236c-4b87-96c8-ba76d635f47a tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c" status: 404 len: 111 microversion: 2.1 time: 0.031475 Sep 21 12:30:35.326272 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 461/904] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:30:35 2022] GET /compute/v2.1/servers/f60cc06f-a959-4872-9552-99d76b9f4c7c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:30:36.466345 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-a232f396-440f-452d-8c82-06ed27dad711 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:30:36.466926 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-a232f396-440f-452d-8c82-06ed27dad711 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:30:36.469638 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:30:36.475512 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a232f396-440f-452d-8c82-06ed27dad711 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:36.476081 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a232f396-440f-452d-8c82-06ed27dad711 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:36.476530 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a232f396-440f-452d-8c82-06ed27dad711 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:36.477455 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a232f396-440f-452d-8c82-06ed27dad711 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:36.477924 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a232f396-440f-452d-8c82-06ed27dad711 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:36.478390 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a232f396-440f-452d-8c82-06ed27dad711 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:36.494653 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.wsgi [None req-a232f396-440f-452d-8c82-06ed27dad711 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] HTTP exception thrown: Instance ee010d1f-46d4-487e-a93e-66c5e2ac895e could not be found. Sep 21 12:30:36.496272 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-a232f396-440f-452d-8c82-06ed27dad711 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Request method failure captured: Sep 21 12:30:36.496272 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: request: DELETE /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e HTTP/1.1 Sep 21 12:30:36.496272 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept: application/json Sep 21 12:30:36.496272 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept-Encoding: identity Sep 21 12:30:36.496272 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Connection: close Sep 21 12:30:36.496272 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Length: 0 Sep 21 12:30:36.496272 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Type: application/json Sep 21 12:30:36.496272 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Host: 10.222.0.71 Sep 21 12:30:36.496272 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Openstack-System-Scope: None Sep 21 12:30:36.496272 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: User-Agent: python-urllib3/1.26.12 Sep 21 12:30:36.496272 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Auth-Token: gAAAAABjKwGp0KjgM_ndjptxwLGhVApHaQzyngoX69SpmnL3OTWtuoH75cPAz9ySdKN9ANQ84Gpscfvltf8W5ER92YP4kr_u_TD1VCoJF2B1xO3RAGirJWPKEvwdA77dha7dIk8YIqrPVzLb-I5bTZ5zfnCJbSYJGEE0BnyXPMZsLyIt9WY4RPs Sep 21 12:30:36.496272 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Id: None Sep 21 12:30:36.496272 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Name: None Sep 21 12:30:36.496272 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Identity-Status: Confirmed Sep 21 12:30:36.496272 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Is-Admin-Project: True Sep 21 12:30:36.496272 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Id: default Sep 21 12:30:36.496272 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Name: Default Sep 21 12:30:36.496272 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Id: 9340222cfe154efe8a6064b197d54499 Sep 21 12:30:36.496272 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Name: tempest-AttachVolumeTestJSON-1528768827 Sep 21 12:30:36.496272 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Role: reader,member Sep 21 12:30:36.496272 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Roles: reader,member Sep 21 12:30:36.497634 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9340222cfe154efe8a6064b197d54499"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9340222cfe154efe8a6064b197d54499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_9340222cfe154efe8a6064b197d54499", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/9340222cfe154efe8a6064b197d54499"}]}] Sep 21 12:30:36.497634 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant: tempest-AttachVolumeTestJSON-1528768827 Sep 21 12:30:36.497634 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Id: 9340222cfe154efe8a6064b197d54499 Sep 21 12:30:36.497634 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1528768827 Sep 21 12:30:36.497634 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User: tempest-AttachVolumeTestJSON-1528768827-project Sep 21 12:30:36.497634 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Id: default Sep 21 12:30:36.497634 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Name: Default Sep 21 12:30:36.497634 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Id: 8790c086dcaa4da5b739bcd02d30b4c0 Sep 21 12:30:36.497634 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Name: tempest-AttachVolumeTestJSON-1528768827-project Sep 21 12:30:36.497634 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: method: > Sep 21 12:30:36.497634 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: exception: Instance ee010d1f-46d4-487e-a93e-66c5e2ac895e could not be found. Sep 21 12:30:36.497634 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: action_args: {'id': 'ee010d1f-46d4-487e-a93e-66c5e2ac895e'} Sep 21 12:30:36.498401 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:30:36.498401 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:30:36.498401 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:30:36.498401 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:30:36.498401 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:30:36.498401 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:30:36.498401 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:30:36.498401 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:30:36.498401 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:30:36.498401 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:30:36.498401 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee010d1f-46d4-487e-a93e-66c5e2ac895e could not be found. Sep 21 12:30:36.498401 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:30:36.498401 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:30:36.498401 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:30:36.498401 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:30:36.498401 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:30:36.498401 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:30:36.498401 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:30:36.498401 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:30:36.498401 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:30:36.499689 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:30:36.499689 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 21 12:30:36.499689 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 21 12:30:36.499689 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 21 12:30:36.499689 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 21 12:30:36.499689 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:30:36.499689 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:30:36.499689 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:30:36.499689 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:30:36.499689 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee010d1f-46d4-487e-a93e-66c5e2ac895e could not be found. Sep 21 12:30:36.499689 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:30:36.499689 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:30:36.499689 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:30:36.499689 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:30:36.499689 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:30:36.499689 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:30:36.499689 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:30:36.499689 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:30:36.499689 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee010d1f-46d4-487e-a93e-66c5e2ac895e could not be found. Sep 21 12:30:36.499689 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:30:36.502037 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-a232f396-440f-452d-8c82-06ed27dad711 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Returning 404 to user: Instance ee010d1f-46d4-487e-a93e-66c5e2ac895e could not be found. {{(pid=120463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:30:36.502037 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-a232f396-440f-452d-8c82-06ed27dad711 tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "DELETE /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 404 len: 111 microversion: 2.1 time: 0.035327 Sep 21 12:30:36.502037 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 444/905] 10.222.0.71 () {58 vars in 1239 bytes} [Wed Sep 21 12:30:36 2022] DELETE /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:30:36.506975 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-5f123103-6cfd-4368-9350-44436683dcdf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:30:36.508286 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-5f123103-6cfd-4368-9350-44436683dcdf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] [instance: ee010d1f-46d4-487e-a93e-66c5e2ac895e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:30:36.515160 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5f123103-6cfd-4368-9350-44436683dcdf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:36.515646 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5f123103-6cfd-4368-9350-44436683dcdf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:36.516115 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5f123103-6cfd-4368-9350-44436683dcdf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:36.516810 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5f123103-6cfd-4368-9350-44436683dcdf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:30:36.517288 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5f123103-6cfd-4368-9350-44436683dcdf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:30:36.517718 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5f123103-6cfd-4368-9350-44436683dcdf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:30:36.530913 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.wsgi [None req-5f123103-6cfd-4368-9350-44436683dcdf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] HTTP exception thrown: Instance ee010d1f-46d4-487e-a93e-66c5e2ac895e could not be found. Sep 21 12:30:36.532509 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-5f123103-6cfd-4368-9350-44436683dcdf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Request method failure captured: Sep 21 12:30:36.532509 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: request: GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e HTTP/1.1 Sep 21 12:30:36.532509 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept: application/json Sep 21 12:30:36.532509 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept-Encoding: identity Sep 21 12:30:36.532509 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Connection: close Sep 21 12:30:36.532509 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Length: 0 Sep 21 12:30:36.532509 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Type: application/json Sep 21 12:30:36.532509 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Host: 10.222.0.71 Sep 21 12:30:36.532509 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Openstack-System-Scope: None Sep 21 12:30:36.532509 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: User-Agent: python-urllib3/1.26.12 Sep 21 12:30:36.532509 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Auth-Token: gAAAAABjKwGp0KjgM_ndjptxwLGhVApHaQzyngoX69SpmnL3OTWtuoH75cPAz9ySdKN9ANQ84Gpscfvltf8W5ER92YP4kr_u_TD1VCoJF2B1xO3RAGirJWPKEvwdA77dha7dIk8YIqrPVzLb-I5bTZ5zfnCJbSYJGEE0BnyXPMZsLyIt9WY4RPs Sep 21 12:30:36.532509 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Id: None Sep 21 12:30:36.532509 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Name: None Sep 21 12:30:36.532509 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Identity-Status: Confirmed Sep 21 12:30:36.532509 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Is-Admin-Project: True Sep 21 12:30:36.532509 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Id: default Sep 21 12:30:36.532509 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Name: Default Sep 21 12:30:36.532509 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Id: 9340222cfe154efe8a6064b197d54499 Sep 21 12:30:36.532509 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Name: tempest-AttachVolumeTestJSON-1528768827 Sep 21 12:30:36.532509 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Role: reader,member Sep 21 12:30:36.532509 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Roles: reader,member Sep 21 12:30:36.534083 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9340222cfe154efe8a6064b197d54499"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9340222cfe154efe8a6064b197d54499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_9340222cfe154efe8a6064b197d54499", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/9340222cfe154efe8a6064b197d54499"}]}] Sep 21 12:30:36.534083 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant: tempest-AttachVolumeTestJSON-1528768827 Sep 21 12:30:36.534083 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Id: 9340222cfe154efe8a6064b197d54499 Sep 21 12:30:36.534083 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1528768827 Sep 21 12:30:36.534083 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User: tempest-AttachVolumeTestJSON-1528768827-project Sep 21 12:30:36.534083 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Id: default Sep 21 12:30:36.534083 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Name: Default Sep 21 12:30:36.534083 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Id: 8790c086dcaa4da5b739bcd02d30b4c0 Sep 21 12:30:36.534083 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Name: tempest-AttachVolumeTestJSON-1528768827-project Sep 21 12:30:36.534083 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: method: > Sep 21 12:30:36.534083 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: exception: Instance ee010d1f-46d4-487e-a93e-66c5e2ac895e could not be found. Sep 21 12:30:36.534083 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: action_args: {'id': 'ee010d1f-46d4-487e-a93e-66c5e2ac895e'} Sep 21 12:30:36.538327 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:30:36.538327 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:30:36.538327 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:30:36.538327 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:30:36.538327 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:30:36.538327 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:30:36.538327 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:30:36.538327 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:30:36.538327 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:30:36.538327 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:30:36.538327 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee010d1f-46d4-487e-a93e-66c5e2ac895e could not be found. Sep 21 12:30:36.538327 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:30:36.538327 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:30:36.538327 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:30:36.538327 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:30:36.538327 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:30:36.538327 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:30:36.538327 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:30:36.538327 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:30:36.538327 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:30:36.540096 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:30:36.540096 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 12:30:36.540096 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 12:30:36.540096 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:30:36.540096 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:30:36.540096 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:30:36.540096 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:30:36.540096 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee010d1f-46d4-487e-a93e-66c5e2ac895e could not be found. Sep 21 12:30:36.540096 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:30:36.540096 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:30:36.540096 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:30:36.540096 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:30:36.540096 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:30:36.540096 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:30:36.540096 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:30:36.540096 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:30:36.540096 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee010d1f-46d4-487e-a93e-66c5e2ac895e could not be found. Sep 21 12:30:36.540096 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:30:36.541211 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-5f123103-6cfd-4368-9350-44436683dcdf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] Returning 404 to user: Instance ee010d1f-46d4-487e-a93e-66c5e2ac895e could not be found. {{(pid=120462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:30:36.541211 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-5f123103-6cfd-4368-9350-44436683dcdf tempest-AttachVolumeTestJSON-1528768827 tempest-AttachVolumeTestJSON-1528768827-project] 10.222.0.71 "GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e" status: 404 len: 111 microversion: 2.1 time: 0.031488 Sep 21 12:30:36.541211 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 462/906] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:30:36 2022] GET /compute/v2.1/servers/ee010d1f-46d4-487e-a93e-66c5e2ac895e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:31:06.973704 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-fe699980-5784-4408-9ccc-ed96cce88958 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:31:06.975882 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-fe699980-5784-4408-9ccc-ed96cce88958 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:31:06.977878 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:06.978511 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=1 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:06.985001 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fe699980-5784-4408-9ccc-ed96cce88958 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:06.985586 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fe699980-5784-4408-9ccc-ed96cce88958 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:06.986112 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fe699980-5784-4408-9ccc-ed96cce88958 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:06.986899 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fe699980-5784-4408-9ccc-ed96cce88958 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:06.987359 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fe699980-5784-4408-9ccc-ed96cce88958 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:06.987831 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fe699980-5784-4408-9ccc-ed96cce88958 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:07.024019 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-fe699980-5784-4408-9ccc-ed96cce88958 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054278 Sep 21 12:31:07.024556 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 445/907] 10.222.0.71 () {60 vars in 1343 bytes} [Wed Sep 21 12:31:06 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:31:07.097755 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-24a758ef-49b7-4067-ac42-70f51e59eede tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:31:07.098809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-24a758ef-49b7-4067-ac42-70f51e59eede tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:31:07.100859 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:07.101812 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=19 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:07.108600 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-24a758ef-49b7-4067-ac42-70f51e59eede tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:07.109082 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-24a758ef-49b7-4067-ac42-70f51e59eede tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:07.109516 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-24a758ef-49b7-4067-ac42-70f51e59eede tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:07.110223 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-24a758ef-49b7-4067-ac42-70f51e59eede tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:07.110678 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-24a758ef-49b7-4067-ac42-70f51e59eede tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:07.111091 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-24a758ef-49b7-4067-ac42-70f51e59eede tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:07.138305 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-24a758ef-49b7-4067-ac42-70f51e59eede tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Going to try to terminate instance {{(pid=120462) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 12:31:07.218915 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-24a758ef-49b7-4067-ac42-70f51e59eede tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "DELETE /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 204 len: 0 microversion: 2.20 time: 0.125489 Sep 21 12:31:07.219530 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 463/908] 10.222.0.71 () {60 vars in 1280 bytes} [Wed Sep 21 12:31:07 2022] DELETE /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 21 12:31:07.228829 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-a8810ba0-3eb0-42fb-8abe-534771379eda tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:31:07.229811 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-a8810ba0-3eb0-42fb-8abe-534771379eda tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:31:07.237586 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a8810ba0-3eb0-42fb-8abe-534771379eda tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:07.238181 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a8810ba0-3eb0-42fb-8abe-534771379eda tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:07.238638 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a8810ba0-3eb0-42fb-8abe-534771379eda tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:07.239385 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a8810ba0-3eb0-42fb-8abe-534771379eda tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:07.239943 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a8810ba0-3eb0-42fb-8abe-534771379eda tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:07.240471 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a8810ba0-3eb0-42fb-8abe-534771379eda tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:07.653933 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a8810ba0-3eb0-42fb-8abe-534771379eda tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:31:07.663539 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a8810ba0-3eb0-42fb-8abe-534771379eda tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:31:07.665043 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a8810ba0-3eb0-42fb-8abe-534771379eda tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:31:07.666234 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-a8810ba0-3eb0-42fb-8abe-534771379eda tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1722 microversion: 2.20 time: 0.441767 Sep 21 12:31:07.666807 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 446/909] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:31:07 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1722 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:31:08.692595 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-54ace5de-002b-43d6-b007-4460f8ae9b98 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:31:08.693292 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-54ace5de-002b-43d6-b007-4460f8ae9b98 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:31:08.701059 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-54ace5de-002b-43d6-b007-4460f8ae9b98 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:08.701646 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-54ace5de-002b-43d6-b007-4460f8ae9b98 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:08.702316 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-54ace5de-002b-43d6-b007-4460f8ae9b98 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:08.703088 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-54ace5de-002b-43d6-b007-4460f8ae9b98 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:08.703610 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-54ace5de-002b-43d6-b007-4460f8ae9b98 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:08.704254 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-54ace5de-002b-43d6-b007-4460f8ae9b98 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:09.148832 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-54ace5de-002b-43d6-b007-4460f8ae9b98 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:31:09.158705 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-54ace5de-002b-43d6-b007-4460f8ae9b98 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:31:09.160526 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-54ace5de-002b-43d6-b007-4460f8ae9b98 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:31:09.162384 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-54ace5de-002b-43d6-b007-4460f8ae9b98 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1722 microversion: 2.20 time: 0.473749 Sep 21 12:31:09.163096 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 464/910] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:31:08 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1722 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 12:31:09.930189 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-84cd6670-77b7-4e5d-b115-f9a9efbbb822 req-d4694468-8ed7-40f4-b6bc-2c7fa5426211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc34c677-0e22-4734-95ed-4a6834d9dc7b", "name": "network-vif-deleted", "tag": "49e15f4c-39c9-4c9a-bb24-e89e5dcc9eab"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:31:09.943196 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-84cd6670-77b7-4e5d-b115-f9a9efbbb822 req-d4694468-8ed7-40f4-b6bc-2c7fa5426211 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:09.944082 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-84cd6670-77b7-4e5d-b115-f9a9efbbb822 req-d4694468-8ed7-40f4-b6bc-2c7fa5426211 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:09.944748 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-84cd6670-77b7-4e5d-b115-f9a9efbbb822 req-d4694468-8ed7-40f4-b6bc-2c7fa5426211 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:09.959713 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-84cd6670-77b7-4e5d-b115-f9a9efbbb822 req-d4694468-8ed7-40f4-b6bc-2c7fa5426211 service nova] Creating event network-vif-deleted:49e15f4c-39c9-4c9a-bb24-e89e5dcc9eab for instance dc34c677-0e22-4734-95ed-4a6834d9dc7b on hv-cinder-85867 Sep 21 12:31:09.966981 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-84cd6670-77b7-4e5d-b115-f9a9efbbb822 req-d4694468-8ed7-40f4-b6bc-2c7fa5426211 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041175 Sep 21 12:31:09.967864 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 447/911] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:31:10.187961 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-c169cf0a-ea64-4f09-9a1c-e81a266d6106 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:31:10.189310 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-c169cf0a-ea64-4f09-9a1c-e81a266d6106 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:31:10.195334 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c169cf0a-ea64-4f09-9a1c-e81a266d6106 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:10.195856 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c169cf0a-ea64-4f09-9a1c-e81a266d6106 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:10.196288 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c169cf0a-ea64-4f09-9a1c-e81a266d6106 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:10.197146 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c169cf0a-ea64-4f09-9a1c-e81a266d6106 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:10.197607 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c169cf0a-ea64-4f09-9a1c-e81a266d6106 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:10.198515 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c169cf0a-ea64-4f09-9a1c-e81a266d6106 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:10.234266 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c169cf0a-ea64-4f09-9a1c-e81a266d6106 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:10.234806 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c169cf0a-ea64-4f09-9a1c-e81a266d6106 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:10.235249 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c169cf0a-ea64-4f09-9a1c-e81a266d6106 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:10.235702 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.objects.instance [None req-c169cf0a-ea64-4f09-9a1c-e81a266d6106 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lazy-loading 'fault' on Instance uuid dc34c677-0e22-4734-95ed-4a6834d9dc7b {{(pid=120462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 12:31:10.284235 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-c169cf0a-ea64-4f09-9a1c-e81a266d6106 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:31:10.292817 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-c169cf0a-ea64-4f09-9a1c-e81a266d6106 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:31:10.294859 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-c169cf0a-ea64-4f09-9a1c-e81a266d6106 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c950eb00b9474b29b86d24983e3b1583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6ef4f3de1943ffbde82d3f0a19542f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:31:10.296063 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-c169cf0a-ea64-4f09-9a1c-e81a266d6106 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 200 len: 1370 microversion: 2.20 time: 0.112739 Sep 21 12:31:10.296623 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 465/912] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:31:10 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 1370 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 12:31:11.322891 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-bba45f7a-038d-49b8-9c3f-46deb5128d8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:31:11.323883 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-bba45f7a-038d-49b8-9c3f-46deb5128d8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:31:11.330930 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bba45f7a-038d-49b8-9c3f-46deb5128d8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:11.331422 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bba45f7a-038d-49b8-9c3f-46deb5128d8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:11.331900 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bba45f7a-038d-49b8-9c3f-46deb5128d8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:11.332608 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bba45f7a-038d-49b8-9c3f-46deb5128d8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:11.333070 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bba45f7a-038d-49b8-9c3f-46deb5128d8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:11.333500 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-bba45f7a-038d-49b8-9c3f-46deb5128d8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:11.349589 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.wsgi [None req-bba45f7a-038d-49b8-9c3f-46deb5128d8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] HTTP exception thrown: Instance dc34c677-0e22-4734-95ed-4a6834d9dc7b could not be found. Sep 21 12:31:11.351336 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-bba45f7a-038d-49b8-9c3f-46deb5128d8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Request method failure captured: Sep 21 12:31:11.351336 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: request: GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b HTTP/1.1 Sep 21 12:31:11.351336 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept: application/json Sep 21 12:31:11.351336 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept-Encoding: identity Sep 21 12:31:11.351336 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Connection: close Sep 21 12:31:11.351336 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Length: 0 Sep 21 12:31:11.351336 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Type: application/json Sep 21 12:31:11.351336 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Host: 10.222.0.71 Sep 21 12:31:11.351336 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Openstack-System-Scope: None Sep 21 12:31:11.351336 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: User-Agent: python-urllib3/1.26.12 Sep 21 12:31:11.351336 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Auth-Token: gAAAAABjKwGi765GAFYA3IAKFcWIzHlC3VCdSEJQ0LsJLWNpr3tTSZGFpuAcEoMVayL0ParxzyNUGFtkK_zpkCauPpiwRc4rVxqR8H6tY5vo-giGXrN6-SEFIgZJqx7d8Xzea8SjUtn7yVuQq51nW7iCSPOm2XM5i8hp4ouwL1pPDADviimkmxA Sep 21 12:31:11.351336 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Id: None Sep 21 12:31:11.351336 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Name: None Sep 21 12:31:11.351336 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Identity-Status: Confirmed Sep 21 12:31:11.351336 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Is-Admin-Project: True Sep 21 12:31:11.351336 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Openstack-Nova-Api-Version: 2.20 Sep 21 12:31:11.351336 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Id: default Sep 21 12:31:11.351336 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Name: Default Sep 21 12:31:11.351336 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Id: 5e6ef4f3de1943ffbde82d3f0a19542f Sep 21 12:31:11.351336 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1081637862 Sep 21 12:31:11.351336 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Role: reader,member Sep 21 12:31:11.351336 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Roles: reader,member Sep 21 12:31:11.353232 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/5e6ef4f3de1943ffbde82d3f0a19542f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/5e6ef4f3de1943ffbde82d3f0a19542f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_5e6ef4f3de1943ffbde82d3f0a19542f", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/5e6ef4f3de1943ffbde82d3f0a19542f"}]}] Sep 21 12:31:11.353232 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1081637862 Sep 21 12:31:11.353232 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Id: 5e6ef4f3de1943ffbde82d3f0a19542f Sep 21 12:31:11.353232 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1081637862 Sep 21 12:31:11.353232 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User: tempest-AttachVolumeShelveTestJSON-1081637862-project Sep 21 12:31:11.353232 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Id: default Sep 21 12:31:11.353232 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Name: Default Sep 21 12:31:11.353232 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Id: c950eb00b9474b29b86d24983e3b1583 Sep 21 12:31:11.353232 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1081637862-project Sep 21 12:31:11.353232 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: method: > Sep 21 12:31:11.353232 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: exception: Instance dc34c677-0e22-4734-95ed-4a6834d9dc7b could not be found. Sep 21 12:31:11.353232 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: action_args: {'id': 'dc34c677-0e22-4734-95ed-4a6834d9dc7b'} Sep 21 12:31:11.354592 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:31:11.354592 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:31:11.354592 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:31:11.354592 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:31:11.354592 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:31:11.354592 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:31:11.354592 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:31:11.354592 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:31:11.354592 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:31:11.354592 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:31:11.354592 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc34c677-0e22-4734-95ed-4a6834d9dc7b could not be found. Sep 21 12:31:11.354592 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:31:11.354592 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:31:11.354592 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:31:11.354592 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:31:11.354592 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:31:11.354592 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:31:11.354592 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:31:11.354592 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:31:11.354592 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:31:11.356195 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:31:11.356195 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 12:31:11.356195 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 12:31:11.356195 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:31:11.356195 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:31:11.356195 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:31:11.356195 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:31:11.356195 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc34c677-0e22-4734-95ed-4a6834d9dc7b could not be found. Sep 21 12:31:11.356195 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:31:11.356195 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:31:11.356195 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:31:11.356195 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:31:11.356195 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:31:11.356195 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:31:11.356195 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:31:11.356195 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:31:11.356195 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc34c677-0e22-4734-95ed-4a6834d9dc7b could not be found. Sep 21 12:31:11.356195 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:31:11.357722 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-bba45f7a-038d-49b8-9c3f-46deb5128d8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Returning 404 to user: Instance dc34c677-0e22-4734-95ed-4a6834d9dc7b could not be found. {{(pid=120463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:31:11.357722 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-bba45f7a-038d-49b8-9c3f-46deb5128d8d tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 404 len: 111 microversion: 2.20 time: 0.035039 Sep 21 12:31:11.357722 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 448/913] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:31:11 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 21 12:31:11.363523 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-2a24f47f-75d4-48e4-a36b-50197a02b073 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '.version_select at 0x7fe4cc6beee0>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:31:11.382932 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-2a24f47f-75d4-48e4-a36b-50197a02b073 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-100653391" status: 204 len: 0 microversion: 2.20 time: 0.024044 Sep 21 12:31:11.383507 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 466/914] 10.222.0.71 () {60 vars in 1259 bytes} [Wed Sep 21 12:31:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-100653391 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 21 12:31:13.197632 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-b286accc-5064-4177-80d9-92ebb4788040 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:31:13.198135 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-b286accc-5064-4177-80d9-92ebb4788040 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:31:13.204773 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b286accc-5064-4177-80d9-92ebb4788040 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:13.205254 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b286accc-5064-4177-80d9-92ebb4788040 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:13.205688 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b286accc-5064-4177-80d9-92ebb4788040 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:13.206377 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b286accc-5064-4177-80d9-92ebb4788040 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:13.206856 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b286accc-5064-4177-80d9-92ebb4788040 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:13.207280 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b286accc-5064-4177-80d9-92ebb4788040 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:13.221926 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.wsgi [None req-b286accc-5064-4177-80d9-92ebb4788040 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] HTTP exception thrown: Instance dc34c677-0e22-4734-95ed-4a6834d9dc7b could not be found. Sep 21 12:31:13.223522 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-b286accc-5064-4177-80d9-92ebb4788040 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Request method failure captured: Sep 21 12:31:13.223522 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: request: DELETE /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b HTTP/1.1 Sep 21 12:31:13.223522 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept: application/json Sep 21 12:31:13.223522 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept-Encoding: identity Sep 21 12:31:13.223522 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Connection: close Sep 21 12:31:13.223522 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Length: 0 Sep 21 12:31:13.223522 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Type: application/json Sep 21 12:31:13.223522 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Host: 10.222.0.71 Sep 21 12:31:13.223522 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Openstack-System-Scope: None Sep 21 12:31:13.223522 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: User-Agent: python-urllib3/1.26.12 Sep 21 12:31:13.223522 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Auth-Token: gAAAAABjKwGi765GAFYA3IAKFcWIzHlC3VCdSEJQ0LsJLWNpr3tTSZGFpuAcEoMVayL0ParxzyNUGFtkK_zpkCauPpiwRc4rVxqR8H6tY5vo-giGXrN6-SEFIgZJqx7d8Xzea8SjUtn7yVuQq51nW7iCSPOm2XM5i8hp4ouwL1pPDADviimkmxA Sep 21 12:31:13.223522 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Id: None Sep 21 12:31:13.223522 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Name: None Sep 21 12:31:13.223522 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Identity-Status: Confirmed Sep 21 12:31:13.223522 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Is-Admin-Project: True Sep 21 12:31:13.223522 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Openstack-Nova-Api-Version: 2.20 Sep 21 12:31:13.223522 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Id: default Sep 21 12:31:13.223522 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Name: Default Sep 21 12:31:13.223522 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Id: 5e6ef4f3de1943ffbde82d3f0a19542f Sep 21 12:31:13.223522 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1081637862 Sep 21 12:31:13.223522 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Role: reader,member Sep 21 12:31:13.223522 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Roles: reader,member Sep 21 12:31:13.225410 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/5e6ef4f3de1943ffbde82d3f0a19542f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/5e6ef4f3de1943ffbde82d3f0a19542f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_5e6ef4f3de1943ffbde82d3f0a19542f", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/5e6ef4f3de1943ffbde82d3f0a19542f"}]}] Sep 21 12:31:13.225410 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1081637862 Sep 21 12:31:13.225410 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Id: 5e6ef4f3de1943ffbde82d3f0a19542f Sep 21 12:31:13.225410 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1081637862 Sep 21 12:31:13.225410 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User: tempest-AttachVolumeShelveTestJSON-1081637862-project Sep 21 12:31:13.225410 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Id: default Sep 21 12:31:13.225410 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Name: Default Sep 21 12:31:13.225410 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Id: c950eb00b9474b29b86d24983e3b1583 Sep 21 12:31:13.225410 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1081637862-project Sep 21 12:31:13.225410 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: method: > Sep 21 12:31:13.225410 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: exception: Instance dc34c677-0e22-4734-95ed-4a6834d9dc7b could not be found. Sep 21 12:31:13.225410 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: action_args: {'id': 'dc34c677-0e22-4734-95ed-4a6834d9dc7b'} Sep 21 12:31:13.226190 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:31:13.226190 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:31:13.226190 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:31:13.226190 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:31:13.226190 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:31:13.226190 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:31:13.226190 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:31:13.226190 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:31:13.226190 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:31:13.226190 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:31:13.226190 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc34c677-0e22-4734-95ed-4a6834d9dc7b could not be found. Sep 21 12:31:13.226190 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:31:13.226190 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:31:13.226190 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:31:13.226190 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:31:13.226190 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:31:13.226190 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:31:13.226190 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:31:13.226190 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:31:13.226190 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:31:13.227389 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:31:13.227389 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 21 12:31:13.227389 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 21 12:31:13.227389 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 21 12:31:13.227389 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 21 12:31:13.227389 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:31:13.227389 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:31:13.227389 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:31:13.227389 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:31:13.227389 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc34c677-0e22-4734-95ed-4a6834d9dc7b could not be found. Sep 21 12:31:13.227389 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:31:13.227389 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:31:13.227389 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:31:13.227389 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:31:13.227389 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:31:13.227389 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:31:13.227389 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:31:13.227389 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:31:13.227389 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc34c677-0e22-4734-95ed-4a6834d9dc7b could not be found. Sep 21 12:31:13.227389 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:31:13.228677 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-b286accc-5064-4177-80d9-92ebb4788040 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Returning 404 to user: Instance dc34c677-0e22-4734-95ed-4a6834d9dc7b could not be found. {{(pid=120463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:31:13.228677 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-b286accc-5064-4177-80d9-92ebb4788040 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "DELETE /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 404 len: 111 microversion: 2.20 time: 0.031296 Sep 21 12:31:13.228677 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 449/915] 10.222.0.71 () {60 vars in 1280 bytes} [Wed Sep 21 12:31:13 2022] DELETE /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 21 12:31:13.235262 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-dd189b20-2b57-4077-a144-cc26fb4116b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:31:13.236130 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-dd189b20-2b57-4077-a144-cc26fb4116b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: dc34c677-0e22-4734-95ed-4a6834d9dc7b] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:31:13.242868 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dd189b20-2b57-4077-a144-cc26fb4116b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:13.243362 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dd189b20-2b57-4077-a144-cc26fb4116b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:13.243835 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dd189b20-2b57-4077-a144-cc26fb4116b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:13.244570 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dd189b20-2b57-4077-a144-cc26fb4116b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:13.245032 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dd189b20-2b57-4077-a144-cc26fb4116b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:13.245459 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dd189b20-2b57-4077-a144-cc26fb4116b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:13.258642 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.wsgi [None req-dd189b20-2b57-4077-a144-cc26fb4116b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] HTTP exception thrown: Instance dc34c677-0e22-4734-95ed-4a6834d9dc7b could not be found. Sep 21 12:31:13.260411 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-dd189b20-2b57-4077-a144-cc26fb4116b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Request method failure captured: Sep 21 12:31:13.260411 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: request: GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b HTTP/1.1 Sep 21 12:31:13.260411 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept: application/json Sep 21 12:31:13.260411 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept-Encoding: identity Sep 21 12:31:13.260411 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Connection: close Sep 21 12:31:13.260411 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Length: 0 Sep 21 12:31:13.260411 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Type: application/json Sep 21 12:31:13.260411 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Host: 10.222.0.71 Sep 21 12:31:13.260411 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Openstack-System-Scope: None Sep 21 12:31:13.260411 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: User-Agent: python-urllib3/1.26.12 Sep 21 12:31:13.260411 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Auth-Token: gAAAAABjKwGi765GAFYA3IAKFcWIzHlC3VCdSEJQ0LsJLWNpr3tTSZGFpuAcEoMVayL0ParxzyNUGFtkK_zpkCauPpiwRc4rVxqR8H6tY5vo-giGXrN6-SEFIgZJqx7d8Xzea8SjUtn7yVuQq51nW7iCSPOm2XM5i8hp4ouwL1pPDADviimkmxA Sep 21 12:31:13.260411 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Id: None Sep 21 12:31:13.260411 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Name: None Sep 21 12:31:13.260411 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Identity-Status: Confirmed Sep 21 12:31:13.260411 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Is-Admin-Project: True Sep 21 12:31:13.260411 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Openstack-Nova-Api-Version: 2.20 Sep 21 12:31:13.260411 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Id: default Sep 21 12:31:13.260411 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Name: Default Sep 21 12:31:13.260411 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Id: 5e6ef4f3de1943ffbde82d3f0a19542f Sep 21 12:31:13.260411 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1081637862 Sep 21 12:31:13.260411 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Role: reader,member Sep 21 12:31:13.260411 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Roles: reader,member Sep 21 12:31:13.262704 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/5e6ef4f3de1943ffbde82d3f0a19542f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/5e6ef4f3de1943ffbde82d3f0a19542f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_5e6ef4f3de1943ffbde82d3f0a19542f", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/5e6ef4f3de1943ffbde82d3f0a19542f"}]}] Sep 21 12:31:13.262704 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1081637862 Sep 21 12:31:13.262704 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Id: 5e6ef4f3de1943ffbde82d3f0a19542f Sep 21 12:31:13.262704 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1081637862 Sep 21 12:31:13.262704 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User: tempest-AttachVolumeShelveTestJSON-1081637862-project Sep 21 12:31:13.262704 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Id: default Sep 21 12:31:13.262704 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Name: Default Sep 21 12:31:13.262704 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Id: c950eb00b9474b29b86d24983e3b1583 Sep 21 12:31:13.262704 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1081637862-project Sep 21 12:31:13.262704 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: method: > Sep 21 12:31:13.262704 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: exception: Instance dc34c677-0e22-4734-95ed-4a6834d9dc7b could not be found. Sep 21 12:31:13.262704 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: action_args: {'id': 'dc34c677-0e22-4734-95ed-4a6834d9dc7b'} Sep 21 12:31:13.264643 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:31:13.264643 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:31:13.264643 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:31:13.264643 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:31:13.264643 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:31:13.264643 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:31:13.264643 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:31:13.264643 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:31:13.264643 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:31:13.264643 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:31:13.264643 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc34c677-0e22-4734-95ed-4a6834d9dc7b could not be found. Sep 21 12:31:13.264643 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:31:13.264643 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:31:13.264643 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:31:13.264643 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:31:13.264643 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:31:13.264643 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:31:13.264643 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:31:13.264643 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:31:13.264643 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:31:13.266489 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:31:13.266489 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 12:31:13.266489 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 12:31:13.266489 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:31:13.266489 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:31:13.266489 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:31:13.266489 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:31:13.266489 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc34c677-0e22-4734-95ed-4a6834d9dc7b could not be found. Sep 21 12:31:13.266489 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:31:13.266489 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:31:13.266489 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:31:13.266489 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:31:13.266489 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:31:13.266489 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:31:13.266489 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:31:13.266489 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:31:13.266489 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc34c677-0e22-4734-95ed-4a6834d9dc7b could not be found. Sep 21 12:31:13.266489 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:31:13.268481 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-dd189b20-2b57-4077-a144-cc26fb4116b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Returning 404 to user: Instance dc34c677-0e22-4734-95ed-4a6834d9dc7b could not be found. {{(pid=120462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:31:13.268481 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-dd189b20-2b57-4077-a144-cc26fb4116b7 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b" status: 404 len: 111 microversion: 2.20 time: 0.031629 Sep 21 12:31:13.268481 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 467/916] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:31:13 2022] GET /compute/v2.1/servers/dc34c677-0e22-4734-95ed-4a6834d9dc7b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 21 12:31:14.406806 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-4a238553-4cbb-4ac8-af4f-05ac5f82f968 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:31:14.407427 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-4a238553-4cbb-4ac8-af4f-05ac5f82f968 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:31:14.413957 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4a238553-4cbb-4ac8-af4f-05ac5f82f968 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:14.414515 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4a238553-4cbb-4ac8-af4f-05ac5f82f968 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:14.415021 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4a238553-4cbb-4ac8-af4f-05ac5f82f968 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:14.415727 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4a238553-4cbb-4ac8-af4f-05ac5f82f968 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:14.416203 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4a238553-4cbb-4ac8-af4f-05ac5f82f968 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:14.416627 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4a238553-4cbb-4ac8-af4f-05ac5f82f968 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:14.430746 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.wsgi [None req-4a238553-4cbb-4ac8-af4f-05ac5f82f968 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] HTTP exception thrown: Instance 5e9ebd08-4c95-43f6-a1a4-3268532d961e could not be found. Sep 21 12:31:14.432385 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-4a238553-4cbb-4ac8-af4f-05ac5f82f968 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Request method failure captured: Sep 21 12:31:14.432385 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: request: DELETE /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e HTTP/1.1 Sep 21 12:31:14.432385 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept: application/json Sep 21 12:31:14.432385 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept-Encoding: identity Sep 21 12:31:14.432385 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Connection: close Sep 21 12:31:14.432385 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Length: 0 Sep 21 12:31:14.432385 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Type: application/json Sep 21 12:31:14.432385 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Host: 10.222.0.71 Sep 21 12:31:14.432385 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Openstack-System-Scope: None Sep 21 12:31:14.432385 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: User-Agent: python-urllib3/1.26.12 Sep 21 12:31:14.432385 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Auth-Token: gAAAAABjKwGi765GAFYA3IAKFcWIzHlC3VCdSEJQ0LsJLWNpr3tTSZGFpuAcEoMVayL0ParxzyNUGFtkK_zpkCauPpiwRc4rVxqR8H6tY5vo-giGXrN6-SEFIgZJqx7d8Xzea8SjUtn7yVuQq51nW7iCSPOm2XM5i8hp4ouwL1pPDADviimkmxA Sep 21 12:31:14.432385 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Id: None Sep 21 12:31:14.432385 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Name: None Sep 21 12:31:14.432385 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Identity-Status: Confirmed Sep 21 12:31:14.432385 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Is-Admin-Project: True Sep 21 12:31:14.432385 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Openstack-Nova-Api-Version: 2.20 Sep 21 12:31:14.432385 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Id: default Sep 21 12:31:14.432385 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Name: Default Sep 21 12:31:14.432385 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Id: 5e6ef4f3de1943ffbde82d3f0a19542f Sep 21 12:31:14.432385 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1081637862 Sep 21 12:31:14.432385 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Role: reader,member Sep 21 12:31:14.432385 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Roles: reader,member Sep 21 12:31:14.433964 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/5e6ef4f3de1943ffbde82d3f0a19542f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/5e6ef4f3de1943ffbde82d3f0a19542f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_5e6ef4f3de1943ffbde82d3f0a19542f", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/5e6ef4f3de1943ffbde82d3f0a19542f"}]}] Sep 21 12:31:14.433964 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1081637862 Sep 21 12:31:14.433964 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Id: 5e6ef4f3de1943ffbde82d3f0a19542f Sep 21 12:31:14.433964 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1081637862 Sep 21 12:31:14.433964 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User: tempest-AttachVolumeShelveTestJSON-1081637862-project Sep 21 12:31:14.433964 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Id: default Sep 21 12:31:14.433964 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Name: Default Sep 21 12:31:14.433964 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Id: c950eb00b9474b29b86d24983e3b1583 Sep 21 12:31:14.433964 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1081637862-project Sep 21 12:31:14.433964 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: method: > Sep 21 12:31:14.433964 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: exception: Instance 5e9ebd08-4c95-43f6-a1a4-3268532d961e could not be found. Sep 21 12:31:14.433964 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: action_args: {'id': '5e9ebd08-4c95-43f6-a1a4-3268532d961e'} Sep 21 12:31:14.434777 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:31:14.434777 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:31:14.434777 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:31:14.434777 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:31:14.434777 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:31:14.434777 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:31:14.434777 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:31:14.434777 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:31:14.434777 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:31:14.434777 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:31:14.434777 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e9ebd08-4c95-43f6-a1a4-3268532d961e could not be found. Sep 21 12:31:14.434777 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:31:14.434777 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:31:14.434777 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:31:14.434777 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:31:14.434777 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:31:14.434777 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:31:14.434777 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:31:14.434777 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:31:14.434777 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:31:14.436245 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:31:14.436245 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 21 12:31:14.436245 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 21 12:31:14.436245 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 21 12:31:14.436245 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 21 12:31:14.436245 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:31:14.436245 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:31:14.436245 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:31:14.436245 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:31:14.436245 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e9ebd08-4c95-43f6-a1a4-3268532d961e could not be found. Sep 21 12:31:14.436245 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:31:14.436245 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:31:14.436245 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:31:14.436245 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:31:14.436245 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:31:14.436245 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:31:14.436245 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:31:14.436245 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:31:14.436245 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e9ebd08-4c95-43f6-a1a4-3268532d961e could not be found. Sep 21 12:31:14.436245 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:31:14.438073 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-4a238553-4cbb-4ac8-af4f-05ac5f82f968 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Returning 404 to user: Instance 5e9ebd08-4c95-43f6-a1a4-3268532d961e could not be found. {{(pid=120463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:31:14.438073 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-4a238553-4cbb-4ac8-af4f-05ac5f82f968 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "DELETE /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 404 len: 111 microversion: 2.20 time: 0.031459 Sep 21 12:31:14.438073 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 450/917] 10.222.0.71 () {60 vars in 1280 bytes} [Wed Sep 21 12:31:14 2022] DELETE /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 21 12:31:14.443702 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-4813d536-916c-46a8-8f9d-fd37bb8a0478 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:31:14.444571 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-4813d536-916c-46a8-8f9d-fd37bb8a0478 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] [instance: 5e9ebd08-4c95-43f6-a1a4-3268532d961e] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:31:14.451882 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4813d536-916c-46a8-8f9d-fd37bb8a0478 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:14.452488 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4813d536-916c-46a8-8f9d-fd37bb8a0478 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:14.456621 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4813d536-916c-46a8-8f9d-fd37bb8a0478 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:14.459115 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4813d536-916c-46a8-8f9d-fd37bb8a0478 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:14.459698 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4813d536-916c-46a8-8f9d-fd37bb8a0478 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:14.460328 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4813d536-916c-46a8-8f9d-fd37bb8a0478 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:14.481060 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.wsgi [None req-4813d536-916c-46a8-8f9d-fd37bb8a0478 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] HTTP exception thrown: Instance 5e9ebd08-4c95-43f6-a1a4-3268532d961e could not be found. Sep 21 12:31:14.483265 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-4813d536-916c-46a8-8f9d-fd37bb8a0478 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Request method failure captured: Sep 21 12:31:14.483265 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: request: GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e HTTP/1.1 Sep 21 12:31:14.483265 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept: application/json Sep 21 12:31:14.483265 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept-Encoding: identity Sep 21 12:31:14.483265 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Connection: close Sep 21 12:31:14.483265 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Length: 0 Sep 21 12:31:14.483265 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Type: application/json Sep 21 12:31:14.483265 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Host: 10.222.0.71 Sep 21 12:31:14.483265 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Openstack-System-Scope: None Sep 21 12:31:14.483265 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: User-Agent: python-urllib3/1.26.12 Sep 21 12:31:14.483265 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Auth-Token: gAAAAABjKwGi765GAFYA3IAKFcWIzHlC3VCdSEJQ0LsJLWNpr3tTSZGFpuAcEoMVayL0ParxzyNUGFtkK_zpkCauPpiwRc4rVxqR8H6tY5vo-giGXrN6-SEFIgZJqx7d8Xzea8SjUtn7yVuQq51nW7iCSPOm2XM5i8hp4ouwL1pPDADviimkmxA Sep 21 12:31:14.483265 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Id: None Sep 21 12:31:14.483265 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Name: None Sep 21 12:31:14.483265 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Identity-Status: Confirmed Sep 21 12:31:14.483265 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Is-Admin-Project: True Sep 21 12:31:14.483265 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Openstack-Nova-Api-Version: 2.20 Sep 21 12:31:14.483265 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Id: default Sep 21 12:31:14.483265 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Name: Default Sep 21 12:31:14.483265 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Id: 5e6ef4f3de1943ffbde82d3f0a19542f Sep 21 12:31:14.483265 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1081637862 Sep 21 12:31:14.483265 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Role: reader,member Sep 21 12:31:14.483265 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Roles: reader,member Sep 21 12:31:14.484931 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/5e6ef4f3de1943ffbde82d3f0a19542f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/5e6ef4f3de1943ffbde82d3f0a19542f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_5e6ef4f3de1943ffbde82d3f0a19542f", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/5e6ef4f3de1943ffbde82d3f0a19542f"}]}] Sep 21 12:31:14.484931 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1081637862 Sep 21 12:31:14.484931 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Id: 5e6ef4f3de1943ffbde82d3f0a19542f Sep 21 12:31:14.484931 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1081637862 Sep 21 12:31:14.484931 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User: tempest-AttachVolumeShelveTestJSON-1081637862-project Sep 21 12:31:14.484931 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Id: default Sep 21 12:31:14.484931 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Name: Default Sep 21 12:31:14.484931 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Id: c950eb00b9474b29b86d24983e3b1583 Sep 21 12:31:14.484931 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1081637862-project Sep 21 12:31:14.484931 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: method: > Sep 21 12:31:14.484931 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: exception: Instance 5e9ebd08-4c95-43f6-a1a4-3268532d961e could not be found. Sep 21 12:31:14.484931 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: action_args: {'id': '5e9ebd08-4c95-43f6-a1a4-3268532d961e'} Sep 21 12:31:14.485753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:31:14.485753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:31:14.485753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:31:14.485753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:31:14.485753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:31:14.485753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:31:14.485753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:31:14.485753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:31:14.485753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:31:14.485753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:31:14.485753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e9ebd08-4c95-43f6-a1a4-3268532d961e could not be found. Sep 21 12:31:14.485753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:31:14.485753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:31:14.485753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:31:14.485753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:31:14.485753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:31:14.485753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:31:14.485753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:31:14.485753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:31:14.485753 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:31:14.486955 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:31:14.486955 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 12:31:14.486955 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 12:31:14.486955 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:31:14.486955 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:31:14.486955 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:31:14.486955 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:31:14.486955 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e9ebd08-4c95-43f6-a1a4-3268532d961e could not be found. Sep 21 12:31:14.486955 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:31:14.486955 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:31:14.486955 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:31:14.486955 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:31:14.486955 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:31:14.486955 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:31:14.486955 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:31:14.486955 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:31:14.486955 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e9ebd08-4c95-43f6-a1a4-3268532d961e could not be found. Sep 21 12:31:14.486955 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:31:14.488055 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-4813d536-916c-46a8-8f9d-fd37bb8a0478 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] Returning 404 to user: Instance 5e9ebd08-4c95-43f6-a1a4-3268532d961e could not be found. {{(pid=120462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:31:14.488055 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-4813d536-916c-46a8-8f9d-fd37bb8a0478 tempest-AttachVolumeShelveTestJSON-1081637862 tempest-AttachVolumeShelveTestJSON-1081637862-project] 10.222.0.71 "GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e" status: 404 len: 111 microversion: 2.20 time: 0.045594 Sep 21 12:31:14.488055 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 468/918] 10.222.0.71 () {60 vars in 1277 bytes} [Wed Sep 21 12:31:14 2022] GET /compute/v2.1/servers/5e9ebd08-4c95-43f6-a1a4-3268532d961e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 21 12:31:23.765909 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-732e397d-243b-4eca-9b59-0e591bd07b7c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Action: 'create', calling method: .version_select at 0x7fe4c9034670>, body: {"keypair": {"name": "tempest-keypair-476170528", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsUJCCz5i8vHxv5eMPcfqZjdsV16Qmg4meLK2N88Gh/8h0i49D72SC1rnE61iWWcKI11IeZ3Aa5gfoLQ4fOe5TEytbDfuEKODsvzZg2LPOaZfGtgNFKYRSStXtdMI5M3g=="}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:31:23.781535 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.quota [None req-732e397d-243b-4eca-9b59-0e591bd07b7c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Getting quotas for project bd7f2ef25e054b619068baf878bead18. Resources: {'key_pairs'} {{(pid=120463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 12:31:23.785696 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.quota [None req-732e397d-243b-4eca-9b59-0e591bd07b7c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Getting quotas for user 90d4dfe489634f3c9346b0ab86408e3b and project bd7f2ef25e054b619068baf878bead18. Resources: {'key_pairs'} {{(pid=120463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 12:31:23.798518 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR oslo.messaging._drivers.impl_rabbit [None req-732e397d-243b-4eca-9b59-0e591bd07b7c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [1a76e2fb-87fc-41a9-be6c-dcfbe62f06e9] AMQP server on 10.222.0.71:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 21 12:31:24.422105 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=20 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:24.806007 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO oslo.messaging._drivers.impl_rabbit [None req-732e397d-243b-4eca-9b59-0e591bd07b7c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [1a76e2fb-87fc-41a9-be6c-dcfbe62f06e9] Reconnected to AMQP server on 10.222.0.71:5672 via [amqp] client with port 44578. Sep 21 12:31:24.822151 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-732e397d-243b-4eca-9b59-0e591bd07b7c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.183219 Sep 21 12:31:24.822695 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 451/919] 10.222.0.71 () {60 vars in 1159 bytes} [Wed Sep 21 12:31:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:31:26.111639 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-8896fdf9-334a-464a-b082-233567f74956 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1446397805", "imageRef": "1e3a8d95-6338-499c-af91-e3d1345af950", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8f74bce-cdd1-4f64-9fe4-35f38581a3e4"}], "security_groups": [{"name": "tempest-securitygroup--44220694"}], "key_name": "tempest-keypair-476170528", "user_data": "}} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:31:26.120806 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:26.122135 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:26.235702 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.network.neutron [None req-8896fdf9-334a-464a-b082-233567f74956 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] validate_networks() for [('e8f74bce-cdd1-4f64-9fe4-35f38581a3e4', None, None, None, None, None)] {{(pid=120462) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 12:31:26.653702 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-8896fdf9-334a-464a-b082-233567f74956 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Flavor limits 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 12:31:26.654450 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-8896fdf9-334a-464a-b082-233567f74956 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Image limits 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 12:31:26.656210 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-8896fdf9-334a-464a-b082-233567f74956 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Flavor pref 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 12:31:26.657552 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-8896fdf9-334a-464a-b082-233567f74956 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Image pref 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 12:31:26.658530 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-8896fdf9-334a-464a-b082-233567f74956 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 12:31:26.669458 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8896fdf9-334a-464a-b082-233567f74956 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:26.669950 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8896fdf9-334a-464a-b082-233567f74956 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:26.670699 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8896fdf9-334a-464a-b082-233567f74956 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:26.671660 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8896fdf9-334a-464a-b082-233567f74956 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:26.672162 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8896fdf9-334a-464a-b082-233567f74956 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:26.672595 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8896fdf9-334a-464a-b082-233567f74956 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:26.691475 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-8896fdf9-334a-464a-b082-233567f74956 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Getting quotas for project bd7f2ef25e054b619068baf878bead18. Resources: {'instances', 'ram', 'cores'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 12:31:26.700059 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-8896fdf9-334a-464a-b082-233567f74956 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Getting quotas for user 90d4dfe489634f3c9346b0ab86408e3b and project bd7f2ef25e054b619068baf878bead18. Resources: {'instances', 'ram', 'cores'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 12:31:26.713328 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-8896fdf9-334a-464a-b082-233567f74956 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Going to run 1 instances... {{(pid=120462) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 12:31:26.715668 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-8896fdf9-334a-464a-b082-233567f74956 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: e17630cc-94bc-4b00-a64e-3c092f04cb1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e3a8d95-6338-499c-af91-e3d1345af950',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 12:31:26.782513 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-8896fdf9-334a-464a-b082-233567f74956 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.675459 Sep 21 12:31:26.783470 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 469/920] 10.222.0.71 () {60 vars in 1147 bytes} [Wed Sep 21 12:31:26 2022] POST /compute/v2.1/servers => generated 400 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 21 12:31:26.795375 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-4d8382e1-2f9f-4c88-8ce7-7c512e3cfa4d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:31:26.796043 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-4d8382e1-2f9f-4c88-8ce7-7c512e3cfa4d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: e17630cc-94bc-4b00-a64e-3c092f04cb1a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:31:26.858698 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-4d8382e1-2f9f-4c88-8ce7-7c512e3cfa4d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:31:26.866470 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-4d8382e1-2f9f-4c88-8ce7-7c512e3cfa4d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a" status: 200 len: 1241 microversion: 2.1 time: 0.075753 Sep 21 12:31:26.867275 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 452/921] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:31:26 2022] GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:31:27.890289 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-2f0b9b1e-9220-496b-8b6d-bdb17142daf3 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:31:27.890850 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-2f0b9b1e-9220-496b-8b6d-bdb17142daf3 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: e17630cc-94bc-4b00-a64e-3c092f04cb1a] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:31:27.897815 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2f0b9b1e-9220-496b-8b6d-bdb17142daf3 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:27.898563 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2f0b9b1e-9220-496b-8b6d-bdb17142daf3 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:27.898962 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2f0b9b1e-9220-496b-8b6d-bdb17142daf3 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:27.899660 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2f0b9b1e-9220-496b-8b6d-bdb17142daf3 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:27.900295 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2f0b9b1e-9220-496b-8b6d-bdb17142daf3 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:27.900911 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2f0b9b1e-9220-496b-8b6d-bdb17142daf3 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:27.979949 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-2f0b9b1e-9220-496b-8b6d-bdb17142daf3 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:31:27.991442 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-2f0b9b1e-9220-496b-8b6d-bdb17142daf3 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a" status: 200 len: 1301 microversion: 2.1 time: 0.103701 Sep 21 12:31:27.992387 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 470/922] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:31:27 2022] GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a => generated 1301 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:31:29.015318 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-a0491152-0b00-4151-9e3a-309ea6e2a508 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:31:29.016092 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-a0491152-0b00-4151-9e3a-309ea6e2a508 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: e17630cc-94bc-4b00-a64e-3c092f04cb1a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:31:29.022689 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a0491152-0b00-4151-9e3a-309ea6e2a508 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:29.023182 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a0491152-0b00-4151-9e3a-309ea6e2a508 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:29.023945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a0491152-0b00-4151-9e3a-309ea6e2a508 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:29.024730 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a0491152-0b00-4151-9e3a-309ea6e2a508 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:29.025200 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a0491152-0b00-4151-9e3a-309ea6e2a508 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:29.025640 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a0491152-0b00-4151-9e3a-309ea6e2a508 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:29.154244 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a0491152-0b00-4151-9e3a-309ea6e2a508 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:31:29.163608 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-a0491152-0b00-4151-9e3a-309ea6e2a508 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a" status: 200 len: 1365 microversion: 2.1 time: 0.152842 Sep 21 12:31:29.164245 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 453/923] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:31:29 2022] GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:31:29.475137 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-6eca3905-7f8c-4fb4-b04c-33955744849e req-541ac8f5-3a76-4558-b974-0caf5e62d312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e17630cc-94bc-4b00-a64e-3c092f04cb1a", "tag": "050f2d58-b5dc-42b1-ac31-96b06caf931b"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:31:29.485787 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-6eca3905-7f8c-4fb4-b04c-33955744849e req-541ac8f5-3a76-4558-b974-0caf5e62d312 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:29.486346 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-6eca3905-7f8c-4fb4-b04c-33955744849e req-541ac8f5-3a76-4558-b974-0caf5e62d312 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:29.486841 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-6eca3905-7f8c-4fb4-b04c-33955744849e req-541ac8f5-3a76-4558-b974-0caf5e62d312 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:29.499543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-6eca3905-7f8c-4fb4-b04c-33955744849e req-541ac8f5-3a76-4558-b974-0caf5e62d312 service nova] Creating event network-changed:050f2d58-b5dc-42b1-ac31-96b06caf931b for instance e17630cc-94bc-4b00-a64e-3c092f04cb1a on hv-cinder-85867 Sep 21 12:31:29.505361 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-6eca3905-7f8c-4fb4-b04c-33955744849e req-541ac8f5-3a76-4558-b974-0caf5e62d312 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034074 Sep 21 12:31:29.505944 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 471/924] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:31:30.187151 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-f8a6fcfa-8e96-47e7-b74e-387bf942e393 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:31:30.187914 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-f8a6fcfa-8e96-47e7-b74e-387bf942e393 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: e17630cc-94bc-4b00-a64e-3c092f04cb1a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:31:30.194297 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f8a6fcfa-8e96-47e7-b74e-387bf942e393 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:30.194788 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f8a6fcfa-8e96-47e7-b74e-387bf942e393 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:30.195231 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f8a6fcfa-8e96-47e7-b74e-387bf942e393 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:30.195969 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f8a6fcfa-8e96-47e7-b74e-387bf942e393 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:30.196439 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f8a6fcfa-8e96-47e7-b74e-387bf942e393 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:30.196879 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f8a6fcfa-8e96-47e7-b74e-387bf942e393 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:30.333658 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-f8a6fcfa-8e96-47e7-b74e-387bf942e393 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:31:30.341674 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-f8a6fcfa-8e96-47e7-b74e-387bf942e393 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a" status: 200 len: 1365 microversion: 2.1 time: 0.159055 Sep 21 12:31:30.342292 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 454/925] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:31:30 2022] GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:31:31.365259 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-dfa1e088-f02a-4750-a6d8-053d5accce1a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:31:31.365951 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-dfa1e088-f02a-4750-a6d8-053d5accce1a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: e17630cc-94bc-4b00-a64e-3c092f04cb1a] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:31:31.372610 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dfa1e088-f02a-4750-a6d8-053d5accce1a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:31.373096 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dfa1e088-f02a-4750-a6d8-053d5accce1a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:31.374118 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dfa1e088-f02a-4750-a6d8-053d5accce1a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:31.374922 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dfa1e088-f02a-4750-a6d8-053d5accce1a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:31.375380 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dfa1e088-f02a-4750-a6d8-053d5accce1a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:31.375847 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dfa1e088-f02a-4750-a6d8-053d5accce1a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:31.509598 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-dfa1e088-f02a-4750-a6d8-053d5accce1a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:31:31.518465 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-dfa1e088-f02a-4750-a6d8-053d5accce1a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a" status: 200 len: 1365 microversion: 2.1 time: 0.157490 Sep 21 12:31:31.519039 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 472/926] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:31:31 2022] GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:31:32.541308 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-29eaf71d-fd8d-427f-97fb-bcba722f0e27 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:31:32.541925 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-29eaf71d-fd8d-427f-97fb-bcba722f0e27 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: e17630cc-94bc-4b00-a64e-3c092f04cb1a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:31:32.548587 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-29eaf71d-fd8d-427f-97fb-bcba722f0e27 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:32.549081 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-29eaf71d-fd8d-427f-97fb-bcba722f0e27 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:32.549519 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-29eaf71d-fd8d-427f-97fb-bcba722f0e27 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:32.550212 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-29eaf71d-fd8d-427f-97fb-bcba722f0e27 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:32.550668 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-29eaf71d-fd8d-427f-97fb-bcba722f0e27 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:32.551093 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-29eaf71d-fd8d-427f-97fb-bcba722f0e27 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:32.681142 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-29eaf71d-fd8d-427f-97fb-bcba722f0e27 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:31:32.688825 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-29eaf71d-fd8d-427f-97fb-bcba722f0e27 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a" status: 200 len: 1365 microversion: 2.1 time: 0.151428 Sep 21 12:31:32.689393 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 455/927] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:31:32 2022] GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:31:33.712498 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-d5cc7487-0bc2-4ee4-82d2-ac4637008bc1 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:31:33.713110 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-d5cc7487-0bc2-4ee4-82d2-ac4637008bc1 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: e17630cc-94bc-4b00-a64e-3c092f04cb1a] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:31:33.720362 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d5cc7487-0bc2-4ee4-82d2-ac4637008bc1 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:33.721073 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d5cc7487-0bc2-4ee4-82d2-ac4637008bc1 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:33.721698 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d5cc7487-0bc2-4ee4-82d2-ac4637008bc1 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:33.722880 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d5cc7487-0bc2-4ee4-82d2-ac4637008bc1 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:33.722880 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d5cc7487-0bc2-4ee4-82d2-ac4637008bc1 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:33.723247 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d5cc7487-0bc2-4ee4-82d2-ac4637008bc1 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:33.858837 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-d5cc7487-0bc2-4ee4-82d2-ac4637008bc1 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:31:33.866721 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-d5cc7487-0bc2-4ee4-82d2-ac4637008bc1 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a" status: 200 len: 1365 microversion: 2.1 time: 0.158219 Sep 21 12:31:33.867307 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 473/928] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:31:33 2022] GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:31:34.889528 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-7aeac7d0-86a5-461a-b5b6-22c292f8a231 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:31:34.890461 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-7aeac7d0-86a5-461a-b5b6-22c292f8a231 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: e17630cc-94bc-4b00-a64e-3c092f04cb1a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:31:34.897025 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7aeac7d0-86a5-461a-b5b6-22c292f8a231 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:34.897516 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7aeac7d0-86a5-461a-b5b6-22c292f8a231 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:34.897967 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7aeac7d0-86a5-461a-b5b6-22c292f8a231 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:34.898670 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7aeac7d0-86a5-461a-b5b6-22c292f8a231 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:34.899147 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7aeac7d0-86a5-461a-b5b6-22c292f8a231 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:34.899579 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7aeac7d0-86a5-461a-b5b6-22c292f8a231 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:35.037105 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-7aeac7d0-86a5-461a-b5b6-22c292f8a231 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:31:35.044795 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-7aeac7d0-86a5-461a-b5b6-22c292f8a231 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a" status: 200 len: 1365 microversion: 2.1 time: 0.159152 Sep 21 12:31:35.045949 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 456/929] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:31:34 2022] GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:31:36.068423 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-a4b17ed3-06a8-47b0-9ee9-0b16e57a31f0 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:31:36.069169 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-a4b17ed3-06a8-47b0-9ee9-0b16e57a31f0 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: e17630cc-94bc-4b00-a64e-3c092f04cb1a] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:31:36.075874 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a4b17ed3-06a8-47b0-9ee9-0b16e57a31f0 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:36.076355 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a4b17ed3-06a8-47b0-9ee9-0b16e57a31f0 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:36.076785 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a4b17ed3-06a8-47b0-9ee9-0b16e57a31f0 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:36.078113 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a4b17ed3-06a8-47b0-9ee9-0b16e57a31f0 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:36.078599 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a4b17ed3-06a8-47b0-9ee9-0b16e57a31f0 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:36.079146 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a4b17ed3-06a8-47b0-9ee9-0b16e57a31f0 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:36.100014 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-8c3526ae-0b64-4087-9d51-45229f53a358 req-4a4988e1-3afa-4763-bc5e-1296829eea7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e17630cc-94bc-4b00-a64e-3c092f04cb1a", "name": "network-vif-plugged", "status": "completed", "tag": "050f2d58-b5dc-42b1-ac31-96b06caf931b"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:31:36.111433 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-8c3526ae-0b64-4087-9d51-45229f53a358 req-4a4988e1-3afa-4763-bc5e-1296829eea7b service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:36.112057 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-8c3526ae-0b64-4087-9d51-45229f53a358 req-4a4988e1-3afa-4763-bc5e-1296829eea7b service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:36.112753 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-8c3526ae-0b64-4087-9d51-45229f53a358 req-4a4988e1-3afa-4763-bc5e-1296829eea7b service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:36.127314 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-8c3526ae-0b64-4087-9d51-45229f53a358 req-4a4988e1-3afa-4763-bc5e-1296829eea7b service nova] Creating event network-vif-plugged:050f2d58-b5dc-42b1-ac31-96b06caf931b for instance e17630cc-94bc-4b00-a64e-3c092f04cb1a on hv-cinder-85867 Sep 21 12:31:36.133059 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-8c3526ae-0b64-4087-9d51-45229f53a358 req-4a4988e1-3afa-4763-bc5e-1296829eea7b service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036914 Sep 21 12:31:36.134427 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 457/930] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:31:36.217090 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-a4b17ed3-06a8-47b0-9ee9-0b16e57a31f0 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:31:36.225419 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-a4b17ed3-06a8-47b0-9ee9-0b16e57a31f0 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a" status: 200 len: 1365 microversion: 2.1 time: 0.160854 Sep 21 12:31:36.225997 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 474/931] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:31:36 2022] GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:31:37.246271 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell0:SELECT=6 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:37.251832 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-03fcbd64-c8f2-4c8f-9d8c-b2bf27781b51 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:31:37.252579 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-03fcbd64-c8f2-4c8f-9d8c-b2bf27781b51 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: e17630cc-94bc-4b00-a64e-3c092f04cb1a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:31:37.254351 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:37.260865 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-03fcbd64-c8f2-4c8f-9d8c-b2bf27781b51 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:37.261403 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-03fcbd64-c8f2-4c8f-9d8c-b2bf27781b51 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:37.261852 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-03fcbd64-c8f2-4c8f-9d8c-b2bf27781b51 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:37.262550 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-03fcbd64-c8f2-4c8f-9d8c-b2bf27781b51 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:37.263013 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-03fcbd64-c8f2-4c8f-9d8c-b2bf27781b51 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:37.263447 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-03fcbd64-c8f2-4c8f-9d8c-b2bf27781b51 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:37.396965 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-03fcbd64-c8f2-4c8f-9d8c-b2bf27781b51 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:31:37.405574 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-03fcbd64-c8f2-4c8f-9d8c-b2bf27781b51 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a" status: 200 len: 1365 microversion: 2.1 time: 0.159702 Sep 21 12:31:37.406148 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 458/932] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:31:37 2022] GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:31:38.430742 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-a0582ac5-fac7-49ff-83dc-630f2442fd66 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:31:38.431567 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-a0582ac5-fac7-49ff-83dc-630f2442fd66 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: e17630cc-94bc-4b00-a64e-3c092f04cb1a] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:31:38.435839 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell0:SELECT=2 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:38.437422 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell0:SELECT=6 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:38.443305 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a0582ac5-fac7-49ff-83dc-630f2442fd66 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:38.443953 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a0582ac5-fac7-49ff-83dc-630f2442fd66 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:38.444485 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a0582ac5-fac7-49ff-83dc-630f2442fd66 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:38.445283 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a0582ac5-fac7-49ff-83dc-630f2442fd66 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:38.445982 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a0582ac5-fac7-49ff-83dc-630f2442fd66 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:38.446564 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a0582ac5-fac7-49ff-83dc-630f2442fd66 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:38.594888 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-a0582ac5-fac7-49ff-83dc-630f2442fd66 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:31:38.602546 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-a0582ac5-fac7-49ff-83dc-630f2442fd66 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a" status: 200 len: 1554 microversion: 2.1 time: 0.176972 Sep 21 12:31:38.603116 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 475/933] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:31:38 2022] GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:31:38.627155 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-672db12b-150f-4e15-ad1c-98d64c4c4d99 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:31:38.627726 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-672db12b-150f-4e15-ad1c-98d64c4c4d99 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: e17630cc-94bc-4b00-a64e-3c092f04cb1a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:31:38.633766 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-672db12b-150f-4e15-ad1c-98d64c4c4d99 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:38.634260 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-672db12b-150f-4e15-ad1c-98d64c4c4d99 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:38.634806 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-672db12b-150f-4e15-ad1c-98d64c4c4d99 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:38.635688 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-672db12b-150f-4e15-ad1c-98d64c4c4d99 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:38.636318 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-672db12b-150f-4e15-ad1c-98d64c4c4d99 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:38.636736 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-672db12b-150f-4e15-ad1c-98d64c4c4d99 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:38.714359 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-672db12b-150f-4e15-ad1c-98d64c4c4d99 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092165 Sep 21 12:31:38.714988 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 459/934] 10.222.0.71 () {58 vars in 1275 bytes} [Wed Sep 21 12:31:38 2022] GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:31:39.880414 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-b2692eb5-62d7-487c-ae71-083b342d5c90 req-bd7db44f-de1f-4728-bbc9-55c3b4f040af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e17630cc-94bc-4b00-a64e-3c092f04cb1a", "tag": "050f2d58-b5dc-42b1-ac31-96b06caf931b"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:31:39.893844 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-b2692eb5-62d7-487c-ae71-083b342d5c90 req-bd7db44f-de1f-4728-bbc9-55c3b4f040af service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:39.894331 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-b2692eb5-62d7-487c-ae71-083b342d5c90 req-bd7db44f-de1f-4728-bbc9-55c3b4f040af service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:39.894771 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-b2692eb5-62d7-487c-ae71-083b342d5c90 req-bd7db44f-de1f-4728-bbc9-55c3b4f040af service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:39.906134 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-b2692eb5-62d7-487c-ae71-083b342d5c90 req-bd7db44f-de1f-4728-bbc9-55c3b4f040af service nova] Creating event network-changed:050f2d58-b5dc-42b1-ac31-96b06caf931b for instance e17630cc-94bc-4b00-a64e-3c092f04cb1a on hv-cinder-85867 Sep 21 12:31:39.911140 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-b2692eb5-62d7-487c-ae71-083b342d5c90 req-bd7db44f-de1f-4728-bbc9-55c3b4f040af service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034448 Sep 21 12:31:39.911773 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 476/935] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:31:47.636286 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-356e597c-6304-4edb-b65e-8e8ede91c195 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:31:47.637552 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-356e597c-6304-4edb-b65e-8e8ede91c195 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:31:47.648271 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-356e597c-6304-4edb-b65e-8e8ede91c195 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:47.648834 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-356e597c-6304-4edb-b65e-8e8ede91c195 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:47.649897 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-356e597c-6304-4edb-b65e-8e8ede91c195 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:47.651059 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-356e597c-6304-4edb-b65e-8e8ede91c195 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:47.651895 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-356e597c-6304-4edb-b65e-8e8ede91c195 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:47.652404 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-356e597c-6304-4edb-b65e-8e8ede91c195 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:47.679360 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.objects.instance [None req-356e597c-6304-4edb-b65e-8e8ede91c195 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lazy-loading 'flavor' on Instance uuid 66e9cb90-c71a-420a-b647-991844d5c17c {{(pid=120463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 12:31:47.760913 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-356e597c-6304-4edb-b65e-8e8ede91c195 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "POST /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c/action" status: 202 len: 0 microversion: 2.1 time: 0.128448 Sep 21 12:31:47.761525 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 460/936] 10.222.0.71 () {60 vars in 1278 bytes} [Wed Sep 21 12:31:47 2022] POST /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 12:31:47.771845 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-9e3c5678-6f32-4bc2-aef3-2f07f5683bd3 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:31:47.772563 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-9e3c5678-6f32-4bc2-aef3-2f07f5683bd3 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:31:47.780413 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9e3c5678-6f32-4bc2-aef3-2f07f5683bd3 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:47.781475 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9e3c5678-6f32-4bc2-aef3-2f07f5683bd3 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:47.781918 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9e3c5678-6f32-4bc2-aef3-2f07f5683bd3 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:47.782702 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9e3c5678-6f32-4bc2-aef3-2f07f5683bd3 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:47.783317 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9e3c5678-6f32-4bc2-aef3-2f07f5683bd3 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:47.783774 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9e3c5678-6f32-4bc2-aef3-2f07f5683bd3 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:47.925344 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-9e3c5678-6f32-4bc2-aef3-2f07f5683bd3 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:31:47.933703 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-9e3c5678-6f32-4bc2-aef3-2f07f5683bd3 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1566 microversion: 2.1 time: 0.166929 Sep 21 12:31:47.934294 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 477/937] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:31:47 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:31:48.958969 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-90566eec-0245-4dc6-987b-fb814063f16e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:31:48.959662 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-90566eec-0245-4dc6-987b-fb814063f16e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:31:48.965880 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-90566eec-0245-4dc6-987b-fb814063f16e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:48.966360 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-90566eec-0245-4dc6-987b-fb814063f16e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:48.966796 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-90566eec-0245-4dc6-987b-fb814063f16e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:48.967479 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-90566eec-0245-4dc6-987b-fb814063f16e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:48.967971 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-90566eec-0245-4dc6-987b-fb814063f16e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:48.968400 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-90566eec-0245-4dc6-987b-fb814063f16e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:49.109904 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-90566eec-0245-4dc6-987b-fb814063f16e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:31:49.118709 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-90566eec-0245-4dc6-987b-fb814063f16e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1566 microversion: 2.1 time: 0.164499 Sep 21 12:31:49.119301 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 461/938] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:31:48 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:31:50.142837 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-3ac7a1b0-799c-4402-8f4c-65e04d55f49e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:31:50.143453 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-3ac7a1b0-799c-4402-8f4c-65e04d55f49e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:31:50.150393 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3ac7a1b0-799c-4402-8f4c-65e04d55f49e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:50.150881 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3ac7a1b0-799c-4402-8f4c-65e04d55f49e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:50.151314 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3ac7a1b0-799c-4402-8f4c-65e04d55f49e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:50.152072 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3ac7a1b0-799c-4402-8f4c-65e04d55f49e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:50.152525 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3ac7a1b0-799c-4402-8f4c-65e04d55f49e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:50.152945 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3ac7a1b0-799c-4402-8f4c-65e04d55f49e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:50.289530 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-3ac7a1b0-799c-4402-8f4c-65e04d55f49e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:31:50.298020 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-3ac7a1b0-799c-4402-8f4c-65e04d55f49e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1566 microversion: 2.1 time: 0.159533 Sep 21 12:31:50.298635 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 478/939] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:31:50 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:31:51.322694 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-e5eae351-4630-494a-9040-c72a140d11f2 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:31:51.323380 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-e5eae351-4630-494a-9040-c72a140d11f2 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:31:51.330204 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e5eae351-4630-494a-9040-c72a140d11f2 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:51.330847 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e5eae351-4630-494a-9040-c72a140d11f2 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:51.331464 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e5eae351-4630-494a-9040-c72a140d11f2 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:51.332376 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e5eae351-4630-494a-9040-c72a140d11f2 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:51.332826 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e5eae351-4630-494a-9040-c72a140d11f2 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:51.333251 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e5eae351-4630-494a-9040-c72a140d11f2 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:51.487270 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-e5eae351-4630-494a-9040-c72a140d11f2 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:31:51.495611 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-e5eae351-4630-494a-9040-c72a140d11f2 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1566 microversion: 2.1 time: 0.177118 Sep 21 12:31:51.496937 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 462/940] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:31:51 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:31:52.521093 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-c66d5201-60d9-4ab6-ae40-35107d90d0e4 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:31:52.522435 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-c66d5201-60d9-4ab6-ae40-35107d90d0e4 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:31:52.529470 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c66d5201-60d9-4ab6-ae40-35107d90d0e4 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:52.529963 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c66d5201-60d9-4ab6-ae40-35107d90d0e4 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:52.530500 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c66d5201-60d9-4ab6-ae40-35107d90d0e4 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:52.531199 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c66d5201-60d9-4ab6-ae40-35107d90d0e4 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:52.531648 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c66d5201-60d9-4ab6-ae40-35107d90d0e4 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:52.532104 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c66d5201-60d9-4ab6-ae40-35107d90d0e4 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:52.820284 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-c66d5201-60d9-4ab6-ae40-35107d90d0e4 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:31:52.832058 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-c66d5201-60d9-4ab6-ae40-35107d90d0e4 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1566 microversion: 2.1 time: 0.316852 Sep 21 12:31:52.832904 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 479/941] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:31:52 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1566 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:31:53.856626 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-f2a050b1-692d-44e9-ba4e-db365a92e5ea tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:31:53.857327 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-f2a050b1-692d-44e9-ba4e-db365a92e5ea tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:31:53.865890 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f2a050b1-692d-44e9-ba4e-db365a92e5ea tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:53.867381 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f2a050b1-692d-44e9-ba4e-db365a92e5ea tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:53.867381 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f2a050b1-692d-44e9-ba4e-db365a92e5ea tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:53.867620 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f2a050b1-692d-44e9-ba4e-db365a92e5ea tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:53.868381 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f2a050b1-692d-44e9-ba4e-db365a92e5ea tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:53.869175 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f2a050b1-692d-44e9-ba4e-db365a92e5ea tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:54.034294 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-f2a050b1-692d-44e9-ba4e-db365a92e5ea tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:31:54.045566 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-f2a050b1-692d-44e9-ba4e-db365a92e5ea tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1566 microversion: 2.1 time: 0.192878 Sep 21 12:31:54.046255 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 463/942] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:31:53 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1566 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:31:55.068419 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-bf487f08-5636-40ac-a387-c776587d4f76 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:31:55.069130 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-bf487f08-5636-40ac-a387-c776587d4f76 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:31:55.077836 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bf487f08-5636-40ac-a387-c776587d4f76 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:55.079329 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bf487f08-5636-40ac-a387-c776587d4f76 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:55.079329 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bf487f08-5636-40ac-a387-c776587d4f76 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:55.080059 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bf487f08-5636-40ac-a387-c776587d4f76 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:55.080709 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bf487f08-5636-40ac-a387-c776587d4f76 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:55.081330 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bf487f08-5636-40ac-a387-c776587d4f76 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:55.299209 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-bf487f08-5636-40ac-a387-c776587d4f76 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:31:55.307241 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-bf487f08-5636-40ac-a387-c776587d4f76 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1566 microversion: 2.1 time: 0.242682 Sep 21 12:31:55.308046 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 480/943] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:31:55 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1566 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:31:56.331629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-2c955b57-5cee-4601-8f6b-4ec28e9cd455 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:31:56.334092 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-2c955b57-5cee-4601-8f6b-4ec28e9cd455 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:31:56.341443 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2c955b57-5cee-4601-8f6b-4ec28e9cd455 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:56.342278 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2c955b57-5cee-4601-8f6b-4ec28e9cd455 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:56.342919 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2c955b57-5cee-4601-8f6b-4ec28e9cd455 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:56.344509 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2c955b57-5cee-4601-8f6b-4ec28e9cd455 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:56.345392 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2c955b57-5cee-4601-8f6b-4ec28e9cd455 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:56.346280 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2c955b57-5cee-4601-8f6b-4ec28e9cd455 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:56.352203 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:56.633827 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-2c955b57-5cee-4601-8f6b-4ec28e9cd455 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:31:56.640957 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-2c955b57-5cee-4601-8f6b-4ec28e9cd455 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1566 microversion: 2.1 time: 0.313733 Sep 21 12:31:56.641543 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 464/944] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:31:56 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1566 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:31:57.667313 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-985b5567-0529-44ea-b326-11e322b74d05 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:31:57.668358 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-985b5567-0529-44ea-b326-11e322b74d05 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:31:57.675344 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:57.677477 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-985b5567-0529-44ea-b326-11e322b74d05 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:57.678202 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-985b5567-0529-44ea-b326-11e322b74d05 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:57.678636 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-985b5567-0529-44ea-b326-11e322b74d05 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:57.679342 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-985b5567-0529-44ea-b326-11e322b74d05 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:57.680497 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-985b5567-0529-44ea-b326-11e322b74d05 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:57.680920 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-985b5567-0529-44ea-b326-11e322b74d05 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:57.684465 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=61 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:57.900909 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-985b5567-0529-44ea-b326-11e322b74d05 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:31:57.910279 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-985b5567-0529-44ea-b326-11e322b74d05 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1566 microversion: 2.1 time: 0.249010 Sep 21 12:31:57.911948 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 481/945] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:31:57 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1566 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:31:58.937240 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-1e3bf59e-f97f-4aae-9eee-f898e2501e84 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:31:58.942794 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-1e3bf59e-f97f-4aae-9eee-f898e2501e84 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:31:58.950512 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1e3bf59e-f97f-4aae-9eee-f898e2501e84 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:58.951524 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1e3bf59e-f97f-4aae-9eee-f898e2501e84 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:58.952183 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1e3bf59e-f97f-4aae-9eee-f898e2501e84 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:58.953137 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1e3bf59e-f97f-4aae-9eee-f898e2501e84 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:31:58.953812 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1e3bf59e-f97f-4aae-9eee-f898e2501e84 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:31:58.954406 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1e3bf59e-f97f-4aae-9eee-f898e2501e84 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:31:59.120248 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-1e3bf59e-f97f-4aae-9eee-f898e2501e84 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:31:59.129287 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-1e3bf59e-f97f-4aae-9eee-f898e2501e84 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1566 microversion: 2.1 time: 0.198078 Sep 21 12:31:59.130414 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 465/946] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:31:58 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1566 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:00.163715 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-557da9f3-7c4a-4f0b-817a-9275a80df21c tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:00.165760 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-557da9f3-7c4a-4f0b-817a-9275a80df21c tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:00.180570 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-557da9f3-7c4a-4f0b-817a-9275a80df21c tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:00.181388 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-557da9f3-7c4a-4f0b-817a-9275a80df21c tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:00.182052 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-557da9f3-7c4a-4f0b-817a-9275a80df21c tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:00.182995 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-557da9f3-7c4a-4f0b-817a-9275a80df21c tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:00.183797 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-557da9f3-7c4a-4f0b-817a-9275a80df21c tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:00.184329 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-557da9f3-7c4a-4f0b-817a-9275a80df21c tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:00.424048 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-557da9f3-7c4a-4f0b-817a-9275a80df21c tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:00.434896 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-557da9f3-7c4a-4f0b-817a-9275a80df21c tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1566 microversion: 2.1 time: 0.276122 Sep 21 12:32:00.435489 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 482/947] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:00 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1566 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:00.900077 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-cd0bd464-b09d-47e5-afa5-0d4cd03c0b40 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Action: 'create', calling method: .version_select at 0x7fe4c902b3a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1277426818", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4ADGl59U0wrzJtjkJ7wR26fQPMIIzMCFTjhVFZXm0J0cf5PIVIqroeYObVbMv/U1+E8l8W2fkJqFCpYiz/w6H6knq1KJtinTQ193HG+OLrvK/kIfvdaSIhvIHL1rzQRg=="}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:32:00.916072 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.quota [None req-cd0bd464-b09d-47e5-afa5-0d4cd03c0b40 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Getting quotas for project 04bda0b59d3b4bfabf6f1b84fec0d6a6. Resources: {'key_pairs'} {{(pid=120463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 12:32:00.920440 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.quota [None req-cd0bd464-b09d-47e5-afa5-0d4cd03c0b40 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Getting quotas for user f84520fd4b434d99ad0dab1a1dd3b033 and project 04bda0b59d3b4bfabf6f1b84fec0d6a6. Resources: {'key_pairs'} {{(pid=120463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 12:32:00.946601 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-cd0bd464-b09d-47e5-afa5-0d4cd03c0b40 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.276965 Sep 21 12:32:00.947224 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 466/948] 10.222.0.71 () {60 vars in 1159 bytes} [Wed Sep 21 12:32:00 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:32:01.458137 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-43e3ad75-c719-4e04-a955-4b9de4eb7bc9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:01.458770 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-43e3ad75-c719-4e04-a955-4b9de4eb7bc9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:01.465720 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-43e3ad75-c719-4e04-a955-4b9de4eb7bc9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:01.466160 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-43e3ad75-c719-4e04-a955-4b9de4eb7bc9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:01.466698 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-43e3ad75-c719-4e04-a955-4b9de4eb7bc9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:01.468076 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-43e3ad75-c719-4e04-a955-4b9de4eb7bc9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:01.468714 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-43e3ad75-c719-4e04-a955-4b9de4eb7bc9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:01.469892 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-43e3ad75-c719-4e04-a955-4b9de4eb7bc9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:01.697190 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-43e3ad75-c719-4e04-a955-4b9de4eb7bc9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:01.712792 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-43e3ad75-c719-4e04-a955-4b9de4eb7bc9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1566 microversion: 2.1 time: 0.258542 Sep 21 12:32:01.713389 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 483/949] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:01 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1566 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:32:02.739801 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-84be9553-923f-463d-817b-3ff4cd025b1d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:02.741064 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-84be9553-923f-463d-817b-3ff4cd025b1d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:02.749374 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-84be9553-923f-463d-817b-3ff4cd025b1d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:02.749938 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-84be9553-923f-463d-817b-3ff4cd025b1d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:02.751031 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-84be9553-923f-463d-817b-3ff4cd025b1d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:02.751852 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-84be9553-923f-463d-817b-3ff4cd025b1d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:02.752249 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-84be9553-923f-463d-817b-3ff4cd025b1d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:02.753042 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-84be9553-923f-463d-817b-3ff4cd025b1d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:02.894479 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-84be9553-923f-463d-817b-3ff4cd025b1d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:02.902440 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-84be9553-923f-463d-817b-3ff4cd025b1d tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1566 microversion: 2.1 time: 0.169188 Sep 21 12:32:02.903093 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 467/950] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:02 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:03.926278 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-941ceaf0-684d-4007-b634-feb6f9db8d08 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:03.928199 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-941ceaf0-684d-4007-b634-feb6f9db8d08 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:03.935359 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-941ceaf0-684d-4007-b634-feb6f9db8d08 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:03.935947 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-941ceaf0-684d-4007-b634-feb6f9db8d08 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:03.936335 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-941ceaf0-684d-4007-b634-feb6f9db8d08 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:03.937394 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-941ceaf0-684d-4007-b634-feb6f9db8d08 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:03.937808 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-941ceaf0-684d-4007-b634-feb6f9db8d08 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:03.938236 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-941ceaf0-684d-4007-b634-feb6f9db8d08 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:04.129061 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-941ceaf0-684d-4007-b634-feb6f9db8d08 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:04.141173 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-941ceaf0-684d-4007-b634-feb6f9db8d08 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1566 microversion: 2.1 time: 0.218143 Sep 21 12:32:04.142084 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 484/951] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:03 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1566 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:05.164848 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-71877c09-8b7c-4b95-9984-4cac58f543fc tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:05.165472 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-71877c09-8b7c-4b95-9984-4cac58f543fc tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:05.172048 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-71877c09-8b7c-4b95-9984-4cac58f543fc tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:05.172532 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-71877c09-8b7c-4b95-9984-4cac58f543fc tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:05.172990 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-71877c09-8b7c-4b95-9984-4cac58f543fc tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:05.174321 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-71877c09-8b7c-4b95-9984-4cac58f543fc tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:05.174781 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-71877c09-8b7c-4b95-9984-4cac58f543fc tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:05.175212 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-71877c09-8b7c-4b95-9984-4cac58f543fc tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:05.310587 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-71877c09-8b7c-4b95-9984-4cac58f543fc tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:05.318361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-71877c09-8b7c-4b95-9984-4cac58f543fc tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1566 microversion: 2.1 time: 0.157463 Sep 21 12:32:05.318938 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 468/952] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:05 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:06.341755 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-221ef7fa-862f-4b0d-a82f-27b024e3a4b9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:06.342422 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-221ef7fa-862f-4b0d-a82f-27b024e3a4b9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:06.349324 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-221ef7fa-862f-4b0d-a82f-27b024e3a4b9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:06.349823 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-221ef7fa-862f-4b0d-a82f-27b024e3a4b9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:06.350270 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-221ef7fa-862f-4b0d-a82f-27b024e3a4b9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:06.351000 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-221ef7fa-862f-4b0d-a82f-27b024e3a4b9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:06.351559 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-221ef7fa-862f-4b0d-a82f-27b024e3a4b9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:06.351999 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-221ef7fa-862f-4b0d-a82f-27b024e3a4b9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:06.491737 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-221ef7fa-862f-4b0d-a82f-27b024e3a4b9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:06.499466 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-221ef7fa-862f-4b0d-a82f-27b024e3a4b9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1566 microversion: 2.1 time: 0.161697 Sep 21 12:32:06.500089 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 485/953] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:06 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:07.523525 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-3a8667d0-8d0b-449d-a23c-7534ed9eb428 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:07.524270 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-3a8667d0-8d0b-449d-a23c-7534ed9eb428 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:07.526674 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:32:07.532544 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3a8667d0-8d0b-449d-a23c-7534ed9eb428 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:07.533045 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3a8667d0-8d0b-449d-a23c-7534ed9eb428 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:07.533491 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3a8667d0-8d0b-449d-a23c-7534ed9eb428 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:07.534408 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3a8667d0-8d0b-449d-a23c-7534ed9eb428 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:07.534657 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3a8667d0-8d0b-449d-a23c-7534ed9eb428 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:07.535094 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3a8667d0-8d0b-449d-a23c-7534ed9eb428 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:07.664509 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-3a8667d0-8d0b-449d-a23c-7534ed9eb428 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:07.672411 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-3a8667d0-8d0b-449d-a23c-7534ed9eb428 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1566 microversion: 2.1 time: 0.152968 Sep 21 12:32:07.672987 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 469/954] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:07 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:08.695901 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-ece43a50-c19e-4c62-b836-50201079d285 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:08.696684 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-ece43a50-c19e-4c62-b836-50201079d285 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:08.703008 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ece43a50-c19e-4c62-b836-50201079d285 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:08.703488 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ece43a50-c19e-4c62-b836-50201079d285 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:08.703964 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ece43a50-c19e-4c62-b836-50201079d285 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:08.704657 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ece43a50-c19e-4c62-b836-50201079d285 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:08.705112 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ece43a50-c19e-4c62-b836-50201079d285 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:08.706036 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ece43a50-c19e-4c62-b836-50201079d285 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:08.840840 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-ece43a50-c19e-4c62-b836-50201079d285 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:08.848568 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-ece43a50-c19e-4c62-b836-50201079d285 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1566 microversion: 2.1 time: 0.156732 Sep 21 12:32:08.849173 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 486/955] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:08 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:09.873555 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-fa783e18-880f-4d64-8d54-9520d1436531 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:09.874402 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-fa783e18-880f-4d64-8d54-9520d1436531 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:09.888150 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fa783e18-880f-4d64-8d54-9520d1436531 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:09.889088 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fa783e18-880f-4d64-8d54-9520d1436531 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:09.889876 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fa783e18-880f-4d64-8d54-9520d1436531 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:09.891246 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fa783e18-880f-4d64-8d54-9520d1436531 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:09.892138 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fa783e18-880f-4d64-8d54-9520d1436531 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:09.892945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fa783e18-880f-4d64-8d54-9520d1436531 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:10.034345 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-fa783e18-880f-4d64-8d54-9520d1436531 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:10.042237 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-fa783e18-880f-4d64-8d54-9520d1436531 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1566 microversion: 2.1 time: 0.174079 Sep 21 12:32:10.042829 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 470/956] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:09 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:11.066029 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-40ce051c-7851-45f6-9d7f-a5891db75748 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:11.066643 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-40ce051c-7851-45f6-9d7f-a5891db75748 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:11.073218 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-40ce051c-7851-45f6-9d7f-a5891db75748 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:11.073702 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-40ce051c-7851-45f6-9d7f-a5891db75748 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:11.074140 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-40ce051c-7851-45f6-9d7f-a5891db75748 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:11.074835 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-40ce051c-7851-45f6-9d7f-a5891db75748 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:11.075292 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-40ce051c-7851-45f6-9d7f-a5891db75748 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:11.075719 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-40ce051c-7851-45f6-9d7f-a5891db75748 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:11.216693 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-40ce051c-7851-45f6-9d7f-a5891db75748 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:11.224759 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-40ce051c-7851-45f6-9d7f-a5891db75748 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1567 microversion: 2.1 time: 0.163063 Sep 21 12:32:11.225339 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 487/957] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:11 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:11.247239 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-2e847c57-517d-4a96-99bf-831b6b9006bb tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:32:11.247873 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-2e847c57-517d-4a96-99bf-831b6b9006bb tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:11.250217 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell0:SELECT=4 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:32:11.256216 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2e847c57-517d-4a96-99bf-831b6b9006bb tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:11.256706 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2e847c57-517d-4a96-99bf-831b6b9006bb tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:11.257150 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2e847c57-517d-4a96-99bf-831b6b9006bb tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:11.257851 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2e847c57-517d-4a96-99bf-831b6b9006bb tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:11.258318 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2e847c57-517d-4a96-99bf-831b6b9006bb tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:11.258747 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2e847c57-517d-4a96-99bf-831b6b9006bb tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:11.291322 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-2e847c57-517d-4a96-99bf-831b6b9006bb tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120463) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 21 12:32:11.357525 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-2e847c57-517d-4a96-99bf-831b6b9006bb tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "POST /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c/action" status: 202 len: 0 microversion: 2.1 time: 0.113814 Sep 21 12:32:11.361152 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 471/958] 10.222.0.71 () {60 vars in 1278 bytes} [Wed Sep 21 12:32:11 2022] POST /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 21 12:32:11.366922 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-c9d88ddd-3409-4ca6-9ddf-6c35954c4e76 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:11.367534 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-c9d88ddd-3409-4ca6-9ddf-6c35954c4e76 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:11.373898 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c9d88ddd-3409-4ca6-9ddf-6c35954c4e76 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:11.374382 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c9d88ddd-3409-4ca6-9ddf-6c35954c4e76 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:11.374817 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c9d88ddd-3409-4ca6-9ddf-6c35954c4e76 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:11.375514 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c9d88ddd-3409-4ca6-9ddf-6c35954c4e76 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:11.376006 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c9d88ddd-3409-4ca6-9ddf-6c35954c4e76 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:11.376429 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-c9d88ddd-3409-4ca6-9ddf-6c35954c4e76 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:11.551849 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-c9d88ddd-3409-4ca6-9ddf-6c35954c4e76 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:11.559600 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-c9d88ddd-3409-4ca6-9ddf-6c35954c4e76 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1515 microversion: 2.1 time: 0.196597 Sep 21 12:32:11.560216 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 488/959] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:11 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1515 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:12.585394 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-882db36c-6ab3-4033-9031-bbfc6bb42df9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:12.585815 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-882db36c-6ab3-4033-9031-bbfc6bb42df9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:12.592146 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-882db36c-6ab3-4033-9031-bbfc6bb42df9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:12.592631 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-882db36c-6ab3-4033-9031-bbfc6bb42df9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:12.593061 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-882db36c-6ab3-4033-9031-bbfc6bb42df9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:12.593756 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-882db36c-6ab3-4033-9031-bbfc6bb42df9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:12.594206 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-882db36c-6ab3-4033-9031-bbfc6bb42df9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:12.594630 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-882db36c-6ab3-4033-9031-bbfc6bb42df9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:12.726059 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-882db36c-6ab3-4033-9031-bbfc6bb42df9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:12.733917 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-882db36c-6ab3-4033-9031-bbfc6bb42df9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1515 microversion: 2.1 time: 0.153578 Sep 21 12:32:12.734499 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 472/960] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:12 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:13.756696 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-b932135e-dbaf-47cf-87a7-83532c600803 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:13.757304 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-b932135e-dbaf-47cf-87a7-83532c600803 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:13.765029 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b932135e-dbaf-47cf-87a7-83532c600803 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:13.765517 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b932135e-dbaf-47cf-87a7-83532c600803 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:13.765957 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b932135e-dbaf-47cf-87a7-83532c600803 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:13.766660 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b932135e-dbaf-47cf-87a7-83532c600803 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:13.767119 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b932135e-dbaf-47cf-87a7-83532c600803 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:13.767547 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b932135e-dbaf-47cf-87a7-83532c600803 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:13.904219 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-b932135e-dbaf-47cf-87a7-83532c600803 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:13.913237 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-b932135e-dbaf-47cf-87a7-83532c600803 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1515 microversion: 2.1 time: 0.160400 Sep 21 12:32:13.913828 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 489/961] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:13 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:14.097648 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-7f7af916-ca05-4ddb-93e6-c74373efd386 req-baa4efaa-301e-4534-8cae-008d9346b89c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66e9cb90-c71a-420a-b647-991844d5c17c", "name": "network-vif-unplugged", "status": "completed", "tag": "15af239b-da86-43fe-81e4-6adb2158f5c6"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:32:14.108906 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-7f7af916-ca05-4ddb-93e6-c74373efd386 req-baa4efaa-301e-4534-8cae-008d9346b89c service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:14.109417 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-7f7af916-ca05-4ddb-93e6-c74373efd386 req-baa4efaa-301e-4534-8cae-008d9346b89c service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:14.109926 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-7f7af916-ca05-4ddb-93e6-c74373efd386 req-baa4efaa-301e-4534-8cae-008d9346b89c service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:14.124388 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.compute.server_external_events [req-7f7af916-ca05-4ddb-93e6-c74373efd386 req-baa4efaa-301e-4534-8cae-008d9346b89c service nova] Unable to find a host for instance 66e9cb90-c71a-420a-b647-991844d5c17c. Dropping event network-vif-unplugged {{(pid=120463) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 21 12:32:14.125327 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-7f7af916-ca05-4ddb-93e6-c74373efd386 req-baa4efaa-301e-4534-8cae-008d9346b89c service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031689 Sep 21 12:32:14.125934 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 473/962] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 21 12:32:14.936300 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-fe9b21bc-40ad-477d-b9be-a7200249c9f2 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:14.936915 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-fe9b21bc-40ad-477d-b9be-a7200249c9f2 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:14.943340 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fe9b21bc-40ad-477d-b9be-a7200249c9f2 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:14.943856 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fe9b21bc-40ad-477d-b9be-a7200249c9f2 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:14.944303 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fe9b21bc-40ad-477d-b9be-a7200249c9f2 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:14.944999 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fe9b21bc-40ad-477d-b9be-a7200249c9f2 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:14.945517 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fe9b21bc-40ad-477d-b9be-a7200249c9f2 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:14.946298 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fe9b21bc-40ad-477d-b9be-a7200249c9f2 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:15.111621 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-fe9b21bc-40ad-477d-b9be-a7200249c9f2 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:15.119891 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-fe9b21bc-40ad-477d-b9be-a7200249c9f2 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1515 microversion: 2.1 time: 0.187543 Sep 21 12:32:15.120472 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 490/963] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:14 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1515 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:16.143594 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-535e7488-f239-4101-8930-b6f2248f506e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:16.144285 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-535e7488-f239-4101-8930-b6f2248f506e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:16.150776 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-535e7488-f239-4101-8930-b6f2248f506e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:16.151264 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-535e7488-f239-4101-8930-b6f2248f506e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:16.151706 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-535e7488-f239-4101-8930-b6f2248f506e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:16.152450 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-535e7488-f239-4101-8930-b6f2248f506e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:16.152920 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-535e7488-f239-4101-8930-b6f2248f506e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:16.153339 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-535e7488-f239-4101-8930-b6f2248f506e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:16.296137 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-535e7488-f239-4101-8930-b6f2248f506e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:16.305342 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-535e7488-f239-4101-8930-b6f2248f506e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1517 microversion: 2.1 time: 0.165626 Sep 21 12:32:16.305919 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 474/964] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:16 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:17.330543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-5331192f-4149-4e22-9a9b-03e65cad9885 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:17.331244 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-5331192f-4149-4e22-9a9b-03e65cad9885 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:17.340551 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5331192f-4149-4e22-9a9b-03e65cad9885 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:17.341042 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5331192f-4149-4e22-9a9b-03e65cad9885 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:17.341476 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5331192f-4149-4e22-9a9b-03e65cad9885 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:17.342190 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5331192f-4149-4e22-9a9b-03e65cad9885 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:17.342632 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5331192f-4149-4e22-9a9b-03e65cad9885 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:17.343058 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5331192f-4149-4e22-9a9b-03e65cad9885 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:17.568930 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-5331192f-4149-4e22-9a9b-03e65cad9885 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:17.577629 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-5331192f-4149-4e22-9a9b-03e65cad9885 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1573 microversion: 2.1 time: 0.251990 Sep 21 12:32:17.578214 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 491/965] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:17 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1573 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:18.606790 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-38e0b05c-e86d-4460-995b-1a18495cab13 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:18.607328 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-38e0b05c-e86d-4460-995b-1a18495cab13 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:18.613449 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-38e0b05c-e86d-4460-995b-1a18495cab13 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:18.613941 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-38e0b05c-e86d-4460-995b-1a18495cab13 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:18.614385 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-38e0b05c-e86d-4460-995b-1a18495cab13 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:18.615089 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-38e0b05c-e86d-4460-995b-1a18495cab13 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:18.615553 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-38e0b05c-e86d-4460-995b-1a18495cab13 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:18.616013 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-38e0b05c-e86d-4460-995b-1a18495cab13 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:18.748694 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-38e0b05c-e86d-4460-995b-1a18495cab13 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:18.757343 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-38e0b05c-e86d-4460-995b-1a18495cab13 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1573 microversion: 2.1 time: 0.155569 Sep 21 12:32:18.757929 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 475/966] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:18 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:19.784334 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-b3354ca7-ec6a-4989-a52b-1dd63e682a03 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:19.784937 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-b3354ca7-ec6a-4989-a52b-1dd63e682a03 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:19.791950 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b3354ca7-ec6a-4989-a52b-1dd63e682a03 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:19.792427 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b3354ca7-ec6a-4989-a52b-1dd63e682a03 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:19.792854 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b3354ca7-ec6a-4989-a52b-1dd63e682a03 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:19.793534 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b3354ca7-ec6a-4989-a52b-1dd63e682a03 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:19.793981 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b3354ca7-ec6a-4989-a52b-1dd63e682a03 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:19.794400 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b3354ca7-ec6a-4989-a52b-1dd63e682a03 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:19.926565 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-b3354ca7-ec6a-4989-a52b-1dd63e682a03 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:19.934238 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-b3354ca7-ec6a-4989-a52b-1dd63e682a03 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1573 microversion: 2.1 time: 0.153808 Sep 21 12:32:19.934803 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 492/967] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:19 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:20.957509 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-10af33f7-a4ce-4514-af8c-cd26632f25d9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:20.958129 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-10af33f7-a4ce-4514-af8c-cd26632f25d9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:20.964616 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-10af33f7-a4ce-4514-af8c-cd26632f25d9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:20.965107 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-10af33f7-a4ce-4514-af8c-cd26632f25d9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:20.965551 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-10af33f7-a4ce-4514-af8c-cd26632f25d9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:20.966251 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-10af33f7-a4ce-4514-af8c-cd26632f25d9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:20.966711 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-10af33f7-a4ce-4514-af8c-cd26632f25d9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:20.967144 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-10af33f7-a4ce-4514-af8c-cd26632f25d9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:21.094534 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-10af33f7-a4ce-4514-af8c-cd26632f25d9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:21.102914 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-10af33f7-a4ce-4514-af8c-cd26632f25d9 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1573 microversion: 2.1 time: 0.149290 Sep 21 12:32:21.103488 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 476/968] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:20 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1573 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:22.126146 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-fe326e00-c48d-4a48-85c3-6e9bf8ab9e23 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:22.126744 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-fe326e00-c48d-4a48-85c3-6e9bf8ab9e23 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:22.134019 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fe326e00-c48d-4a48-85c3-6e9bf8ab9e23 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:22.134535 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fe326e00-c48d-4a48-85c3-6e9bf8ab9e23 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:22.134972 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fe326e00-c48d-4a48-85c3-6e9bf8ab9e23 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:22.135662 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fe326e00-c48d-4a48-85c3-6e9bf8ab9e23 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:22.136156 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fe326e00-c48d-4a48-85c3-6e9bf8ab9e23 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:22.136580 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fe326e00-c48d-4a48-85c3-6e9bf8ab9e23 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:22.264580 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-fe326e00-c48d-4a48-85c3-6e9bf8ab9e23 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:22.272267 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-fe326e00-c48d-4a48-85c3-6e9bf8ab9e23 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1573 microversion: 2.1 time: 0.150032 Sep 21 12:32:22.272838 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 493/969] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:22 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1573 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:23.295809 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-7f53a7cd-e3ed-4a7d-96b6-937097148ac8 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:23.296386 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-7f53a7cd-e3ed-4a7d-96b6-937097148ac8 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:23.303871 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7f53a7cd-e3ed-4a7d-96b6-937097148ac8 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:23.304375 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7f53a7cd-e3ed-4a7d-96b6-937097148ac8 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:23.304815 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7f53a7cd-e3ed-4a7d-96b6-937097148ac8 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:23.305524 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7f53a7cd-e3ed-4a7d-96b6-937097148ac8 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:23.305983 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7f53a7cd-e3ed-4a7d-96b6-937097148ac8 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:23.306416 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7f53a7cd-e3ed-4a7d-96b6-937097148ac8 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:23.453280 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-7f53a7cd-e3ed-4a7d-96b6-937097148ac8 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:23.461072 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-7f53a7cd-e3ed-4a7d-96b6-937097148ac8 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1573 microversion: 2.1 time: 0.169316 Sep 21 12:32:23.461637 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 477/970] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:23 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1573 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:23.756104 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-b1cc4870-591c-4611-83b4-25970081af05 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-528024937", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1277426818", "security_groups": [{"name": "tempest-secgroup-smoke-2134419953"}], "block_device_mapping_v2": [{"uuid": "2a9f1e02-3861-4cb7-8479-fcf1b9894ccf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "df063f4b-39ab-4616-b570-b4e44f12336f"}]}} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:32:23.876664 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.network.neutron [None req-b1cc4870-591c-4611-83b4-25970081af05 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] validate_networks() for [('df063f4b-39ab-4616-b570-b4e44f12336f', None, None, None, None, None)] {{(pid=120462) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 12:32:24.281307 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-b1cc4870-591c-4611-83b4-25970081af05 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Flavor limits 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 12:32:24.281736 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-b1cc4870-591c-4611-83b4-25970081af05 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Image limits 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 12:32:24.282212 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-b1cc4870-591c-4611-83b4-25970081af05 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Flavor pref 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 12:32:24.282624 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-b1cc4870-591c-4611-83b4-25970081af05 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Image pref 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 12:32:24.283039 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-b1cc4870-591c-4611-83b4-25970081af05 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 12:32:24.292508 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b1cc4870-591c-4611-83b4-25970081af05 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:24.292993 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b1cc4870-591c-4611-83b4-25970081af05 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:24.293442 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b1cc4870-591c-4611-83b4-25970081af05 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:24.294179 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b1cc4870-591c-4611-83b4-25970081af05 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:24.294646 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b1cc4870-591c-4611-83b4-25970081af05 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:24.295080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b1cc4870-591c-4611-83b4-25970081af05 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:24.312833 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-b1cc4870-591c-4611-83b4-25970081af05 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Getting quotas for project 04bda0b59d3b4bfabf6f1b84fec0d6a6. Resources: {'instances', 'ram', 'cores'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 12:32:24.316820 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-b1cc4870-591c-4611-83b4-25970081af05 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Getting quotas for user f84520fd4b434d99ad0dab1a1dd3b033 and project 04bda0b59d3b4bfabf6f1b84fec0d6a6. Resources: {'instances', 'ram', 'cores'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 12:32:24.376302 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-b1cc4870-591c-4611-83b4-25970081af05 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Going to run 1 instances... {{(pid=120462) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 12:32:24.378473 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-b1cc4870-591c-4611-83b4-25970081af05 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2a9f1e02-3861-4cb7-8479-fcf1b9894ccf',volume_size=None,volume_type=None)] {{(pid=120462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 12:32:24.483537 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-be00d6ec-e16c-4b18-ba8d-e0b2991da771 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:24.484192 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-be00d6ec-e16c-4b18-ba8d-e0b2991da771 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:24.491178 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-be00d6ec-e16c-4b18-ba8d-e0b2991da771 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:24.491682 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-be00d6ec-e16c-4b18-ba8d-e0b2991da771 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:24.492197 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-be00d6ec-e16c-4b18-ba8d-e0b2991da771 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:24.492915 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-be00d6ec-e16c-4b18-ba8d-e0b2991da771 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:24.493375 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-be00d6ec-e16c-4b18-ba8d-e0b2991da771 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:24.493852 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-be00d6ec-e16c-4b18-ba8d-e0b2991da771 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:24.506799 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-b1cc4870-591c-4611-83b4-25970081af05 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.754588 Sep 21 12:32:24.507646 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 494/971] 10.222.0.71 () {60 vars in 1147 bytes} [Wed Sep 21 12:32:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 21 12:32:24.518739 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-8aaedda6-96a2-4873-9632-bc6ddb420c0f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:24.519672 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-8aaedda6-96a2-4873-9632-bc6ddb420c0f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:24.578112 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-8aaedda6-96a2-4873-9632-bc6ddb420c0f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:24.589230 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-8aaedda6-96a2-4873-9632-bc6ddb420c0f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23" status: 200 len: 1094 microversion: 2.1 time: 0.074526 Sep 21 12:32:24.596161 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 495/972] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:24 2022] GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:32:24.634739 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-be00d6ec-e16c-4b18-ba8d-e0b2991da771 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:24.643270 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-be00d6ec-e16c-4b18-ba8d-e0b2991da771 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1573 microversion: 2.1 time: 0.163697 Sep 21 12:32:24.644314 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 478/973] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:24 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:32:25.612189 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-a88422cd-a5bf-46bc-bb21-9785163f3a09 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:25.612831 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-a88422cd-a5bf-46bc-bb21-9785163f3a09 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:25.619271 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a88422cd-a5bf-46bc-bb21-9785163f3a09 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:25.619777 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a88422cd-a5bf-46bc-bb21-9785163f3a09 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:25.620233 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a88422cd-a5bf-46bc-bb21-9785163f3a09 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:25.620931 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a88422cd-a5bf-46bc-bb21-9785163f3a09 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:25.621391 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a88422cd-a5bf-46bc-bb21-9785163f3a09 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:25.621821 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a88422cd-a5bf-46bc-bb21-9785163f3a09 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:25.668283 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-e9448e43-046d-474f-bc97-ea3ea5d8725e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:25.668918 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-e9448e43-046d-474f-bc97-ea3ea5d8725e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:25.675401 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e9448e43-046d-474f-bc97-ea3ea5d8725e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:25.675937 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e9448e43-046d-474f-bc97-ea3ea5d8725e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:25.676389 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e9448e43-046d-474f-bc97-ea3ea5d8725e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:25.677095 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e9448e43-046d-474f-bc97-ea3ea5d8725e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:25.677561 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e9448e43-046d-474f-bc97-ea3ea5d8725e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:25.678000 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e9448e43-046d-474f-bc97-ea3ea5d8725e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:25.687686 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-a88422cd-a5bf-46bc-bb21-9785163f3a09 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:25.696578 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-a88422cd-a5bf-46bc-bb21-9785163f3a09 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23" status: 200 len: 1144 microversion: 2.1 time: 0.088230 Sep 21 12:32:25.697327 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 496/974] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:25 2022] GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 => generated 1144 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:25.816289 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-e9448e43-046d-474f-bc97-ea3ea5d8725e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:25.824216 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-e9448e43-046d-474f-bc97-ea3ea5d8725e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1573 microversion: 2.1 time: 0.160474 Sep 21 12:32:25.824999 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 479/975] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:25 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:26.720376 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-9fbb9dbe-fb90-4f05-bd43-8ddc818b504d tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:26.720983 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-9fbb9dbe-fb90-4f05-bd43-8ddc818b504d tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:26.728322 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9fbb9dbe-fb90-4f05-bd43-8ddc818b504d tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:26.728816 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9fbb9dbe-fb90-4f05-bd43-8ddc818b504d tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:26.729263 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9fbb9dbe-fb90-4f05-bd43-8ddc818b504d tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:26.729976 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9fbb9dbe-fb90-4f05-bd43-8ddc818b504d tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:26.730441 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9fbb9dbe-fb90-4f05-bd43-8ddc818b504d tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:26.730869 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9fbb9dbe-fb90-4f05-bd43-8ddc818b504d tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:26.848151 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-330b3f6a-df23-48bc-b44b-730d95e252de tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:26.848705 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-330b3f6a-df23-48bc-b44b-730d95e252de tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:26.855772 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-330b3f6a-df23-48bc-b44b-730d95e252de tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:26.856300 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-330b3f6a-df23-48bc-b44b-730d95e252de tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:26.856927 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-330b3f6a-df23-48bc-b44b-730d95e252de tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:26.857820 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-330b3f6a-df23-48bc-b44b-730d95e252de tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:26.858277 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-330b3f6a-df23-48bc-b44b-730d95e252de tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:26.858706 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-330b3f6a-df23-48bc-b44b-730d95e252de tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:26.863312 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:32:26.939355 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-9fbb9dbe-fb90-4f05-bd43-8ddc818b504d tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:26.949244 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-9fbb9dbe-fb90-4f05-bd43-8ddc818b504d tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23" status: 200 len: 1210 microversion: 2.1 time: 0.232543 Sep 21 12:32:26.949882 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 497/976] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:26 2022] GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 => generated 1210 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:27.241955 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-330b3f6a-df23-48bc-b44b-730d95e252de tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:27.250018 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-330b3f6a-df23-48bc-b44b-730d95e252de tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1573 microversion: 2.1 time: 0.405847 Sep 21 12:32:27.250810 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 480/977] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:26 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1573 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:32:27.974351 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-3551f905-55e0-4cd8-b2f6-a537e4374ce2 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:27.974968 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-3551f905-55e0-4cd8-b2f6-a537e4374ce2 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:27.977418 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:32:27.982747 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3551f905-55e0-4cd8-b2f6-a537e4374ce2 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:27.983302 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3551f905-55e0-4cd8-b2f6-a537e4374ce2 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:27.983669 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3551f905-55e0-4cd8-b2f6-a537e4374ce2 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:27.984389 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3551f905-55e0-4cd8-b2f6-a537e4374ce2 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:27.984843 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3551f905-55e0-4cd8-b2f6-a537e4374ce2 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:27.985267 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3551f905-55e0-4cd8-b2f6-a537e4374ce2 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:27.990312 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=92 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:32:28.221042 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-3551f905-55e0-4cd8-b2f6-a537e4374ce2 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:28.248520 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-1f3eb7f7-dd7c-48de-8aa1-6e28a0ade174 req-a35951ab-9e1b-4fbf-9ed2-9ad2eaee147b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23", "tag": "30cdd6f9-678f-4f65-b2ab-284e35d1463a"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:32:28.257681 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-3551f905-55e0-4cd8-b2f6-a537e4374ce2 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23" status: 200 len: 1266 microversion: 2.1 time: 0.287000 Sep 21 12:32:28.260146 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 498/978] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:27 2022] GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 => generated 1266 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:28.280319 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-1f3eb7f7-dd7c-48de-8aa1-6e28a0ade174 req-a35951ab-9e1b-4fbf-9ed2-9ad2eaee147b service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:28.280819 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-1f3eb7f7-dd7c-48de-8aa1-6e28a0ade174 req-a35951ab-9e1b-4fbf-9ed2-9ad2eaee147b service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:28.281261 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-1f3eb7f7-dd7c-48de-8aa1-6e28a0ade174 req-a35951ab-9e1b-4fbf-9ed2-9ad2eaee147b service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:28.288681 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-37d39674-0a55-4d54-b132-742fbbc99b08 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:28.289386 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-37d39674-0a55-4d54-b132-742fbbc99b08 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:28.305110 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-37d39674-0a55-4d54-b132-742fbbc99b08 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:28.305702 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-37d39674-0a55-4d54-b132-742fbbc99b08 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:28.307387 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-37d39674-0a55-4d54-b132-742fbbc99b08 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:28.311005 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-37d39674-0a55-4d54-b132-742fbbc99b08 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:28.311523 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-37d39674-0a55-4d54-b132-742fbbc99b08 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:28.312007 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-37d39674-0a55-4d54-b132-742fbbc99b08 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:28.315670 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-1f3eb7f7-dd7c-48de-8aa1-6e28a0ade174 req-a35951ab-9e1b-4fbf-9ed2-9ad2eaee147b service nova] Creating event network-changed:30cdd6f9-678f-4f65-b2ab-284e35d1463a for instance 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 on hv-cinder-85867 Sep 21 12:32:28.324661 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-1f3eb7f7-dd7c-48de-8aa1-6e28a0ade174 req-a35951ab-9e1b-4fbf-9ed2-9ad2eaee147b service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159078 Sep 21 12:32:28.326069 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 481/979] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:32:28.334311 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-05fe067a-56a1-4318-971c-f52a33433b44 req-1b882b8b-0a22-48bd-8755-2ccd365925a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66e9cb90-c71a-420a-b647-991844d5c17c", "name": "network-vif-plugged", "status": "completed", "tag": "15af239b-da86-43fe-81e4-6adb2158f5c6"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:32:28.344626 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-05fe067a-56a1-4318-971c-f52a33433b44 req-1b882b8b-0a22-48bd-8755-2ccd365925a0 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:28.345398 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-05fe067a-56a1-4318-971c-f52a33433b44 req-1b882b8b-0a22-48bd-8755-2ccd365925a0 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:28.345841 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-05fe067a-56a1-4318-971c-f52a33433b44 req-1b882b8b-0a22-48bd-8755-2ccd365925a0 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:28.359099 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-05fe067a-56a1-4318-971c-f52a33433b44 req-1b882b8b-0a22-48bd-8755-2ccd365925a0 service nova] Creating event network-vif-plugged:15af239b-da86-43fe-81e4-6adb2158f5c6 for instance 66e9cb90-c71a-420a-b647-991844d5c17c on hv-cinder-85867 Sep 21 12:32:28.364467 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-05fe067a-56a1-4318-971c-f52a33433b44 req-1b882b8b-0a22-48bd-8755-2ccd365925a0 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036422 Sep 21 12:32:28.365084 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 482/980] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:32:28.491860 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-37d39674-0a55-4d54-b132-742fbbc99b08 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:28.500099 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-37d39674-0a55-4d54-b132-742fbbc99b08 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1573 microversion: 2.1 time: 0.215265 Sep 21 12:32:28.500774 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 499/981] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:28 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1573 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:29.286035 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-1a9971ac-2f85-4b27-a4c1-2ea8f18b4e44 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:29.286745 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-1a9971ac-2f85-4b27-a4c1-2ea8f18b4e44 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:29.293964 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1a9971ac-2f85-4b27-a4c1-2ea8f18b4e44 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:29.294457 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1a9971ac-2f85-4b27-a4c1-2ea8f18b4e44 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:29.294897 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1a9971ac-2f85-4b27-a4c1-2ea8f18b4e44 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:29.295589 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1a9971ac-2f85-4b27-a4c1-2ea8f18b4e44 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:29.296084 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1a9971ac-2f85-4b27-a4c1-2ea8f18b4e44 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:29.296519 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1a9971ac-2f85-4b27-a4c1-2ea8f18b4e44 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:29.429708 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-1a9971ac-2f85-4b27-a4c1-2ea8f18b4e44 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:29.437520 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-1a9971ac-2f85-4b27-a4c1-2ea8f18b4e44 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23" status: 200 len: 1266 microversion: 2.1 time: 0.155793 Sep 21 12:32:29.438109 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 483/982] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:29 2022] GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:29.524834 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-a9ef48e7-5675-4409-a49f-cf482be286e4 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:29.525442 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-a9ef48e7-5675-4409-a49f-cf482be286e4 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:29.531802 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a9ef48e7-5675-4409-a49f-cf482be286e4 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:29.532282 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a9ef48e7-5675-4409-a49f-cf482be286e4 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:29.532724 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a9ef48e7-5675-4409-a49f-cf482be286e4 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:29.533407 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a9ef48e7-5675-4409-a49f-cf482be286e4 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:29.533846 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a9ef48e7-5675-4409-a49f-cf482be286e4 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:29.534269 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a9ef48e7-5675-4409-a49f-cf482be286e4 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:29.664188 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-a9ef48e7-5675-4409-a49f-cf482be286e4 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:29.671800 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-a9ef48e7-5675-4409-a49f-cf482be286e4 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1573 microversion: 2.1 time: 0.151503 Sep 21 12:32:29.672374 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 500/983] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:29 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:30.460633 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-2d551e2c-27c1-426d-bbee-5f0388e30fed tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:30.461260 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-2d551e2c-27c1-426d-bbee-5f0388e30fed tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:30.467613 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2d551e2c-27c1-426d-bbee-5f0388e30fed tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:30.468142 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2d551e2c-27c1-426d-bbee-5f0388e30fed tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:30.468588 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2d551e2c-27c1-426d-bbee-5f0388e30fed tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:30.469345 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2d551e2c-27c1-426d-bbee-5f0388e30fed tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:30.469763 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2d551e2c-27c1-426d-bbee-5f0388e30fed tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:30.470195 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2d551e2c-27c1-426d-bbee-5f0388e30fed tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:30.606523 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-2d551e2c-27c1-426d-bbee-5f0388e30fed tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:30.616963 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-2d551e2c-27c1-426d-bbee-5f0388e30fed tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23" status: 200 len: 1266 microversion: 2.1 time: 0.160136 Sep 21 12:32:30.617558 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 484/984] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:30 2022] GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:32:30.695446 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-d52bd270-c979-4572-9bdc-3414daf81e00 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:30.696064 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-d52bd270-c979-4572-9bdc-3414daf81e00 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:30.702205 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d52bd270-c979-4572-9bdc-3414daf81e00 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:30.702924 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d52bd270-c979-4572-9bdc-3414daf81e00 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:30.703353 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d52bd270-c979-4572-9bdc-3414daf81e00 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:30.704134 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d52bd270-c979-4572-9bdc-3414daf81e00 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:30.704534 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d52bd270-c979-4572-9bdc-3414daf81e00 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:30.704961 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d52bd270-c979-4572-9bdc-3414daf81e00 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:30.981659 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-d52bd270-c979-4572-9bdc-3414daf81e00 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:30.989778 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-d52bd270-c979-4572-9bdc-3414daf81e00 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1573 microversion: 2.1 time: 0.298769 Sep 21 12:32:30.990357 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 501/985] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:30 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1573 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:31.640286 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-c0ff1af9-fa52-4e1a-b569-9dedfb637ef6 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:31.640919 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-c0ff1af9-fa52-4e1a-b569-9dedfb637ef6 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:31.648109 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0ff1af9-fa52-4e1a-b569-9dedfb637ef6 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:31.648590 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0ff1af9-fa52-4e1a-b569-9dedfb637ef6 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:31.649023 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0ff1af9-fa52-4e1a-b569-9dedfb637ef6 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:31.649706 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0ff1af9-fa52-4e1a-b569-9dedfb637ef6 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:31.650157 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0ff1af9-fa52-4e1a-b569-9dedfb637ef6 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:31.650579 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c0ff1af9-fa52-4e1a-b569-9dedfb637ef6 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:31.782889 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-c0ff1af9-fa52-4e1a-b569-9dedfb637ef6 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:31.790500 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-c0ff1af9-fa52-4e1a-b569-9dedfb637ef6 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23" status: 200 len: 1266 microversion: 2.1 time: 0.154110 Sep 21 12:32:31.791069 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 485/986] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:31 2022] GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:32.014210 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-b2cd43f7-3fa1-40c5-a646-73b43ca16954 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:32.014819 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-b2cd43f7-3fa1-40c5-a646-73b43ca16954 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:32.021210 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b2cd43f7-3fa1-40c5-a646-73b43ca16954 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:32.021692 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b2cd43f7-3fa1-40c5-a646-73b43ca16954 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:32.022128 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b2cd43f7-3fa1-40c5-a646-73b43ca16954 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:32.022817 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b2cd43f7-3fa1-40c5-a646-73b43ca16954 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:32.023405 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b2cd43f7-3fa1-40c5-a646-73b43ca16954 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:32.023862 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b2cd43f7-3fa1-40c5-a646-73b43ca16954 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:32.167983 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-b2cd43f7-3fa1-40c5-a646-73b43ca16954 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:32.176117 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-b2cd43f7-3fa1-40c5-a646-73b43ca16954 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1560 microversion: 2.1 time: 0.165715 Sep 21 12:32:32.176722 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 502/987] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:32 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:32.814369 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-d74db730-b9c3-4436-8251-00006d26a04f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:32.815118 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-d74db730-b9c3-4436-8251-00006d26a04f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:32.821757 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d74db730-b9c3-4436-8251-00006d26a04f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:32.822249 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d74db730-b9c3-4436-8251-00006d26a04f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:32.822692 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d74db730-b9c3-4436-8251-00006d26a04f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:32.823396 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d74db730-b9c3-4436-8251-00006d26a04f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:32.823893 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d74db730-b9c3-4436-8251-00006d26a04f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:32.824332 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d74db730-b9c3-4436-8251-00006d26a04f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:32.960576 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-d74db730-b9c3-4436-8251-00006d26a04f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:32.969252 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-d74db730-b9c3-4436-8251-00006d26a04f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23" status: 200 len: 1266 microversion: 2.1 time: 0.158973 Sep 21 12:32:32.969873 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 486/988] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:32 2022] GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:33.993131 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-a85eb921-2a96-4043-9815-f80307c33bbd tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:33.993720 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-a85eb921-2a96-4043-9815-f80307c33bbd tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:34.000118 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a85eb921-2a96-4043-9815-f80307c33bbd tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:34.000593 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a85eb921-2a96-4043-9815-f80307c33bbd tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:34.001020 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a85eb921-2a96-4043-9815-f80307c33bbd tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:34.001698 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a85eb921-2a96-4043-9815-f80307c33bbd tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:34.002147 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a85eb921-2a96-4043-9815-f80307c33bbd tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:34.002565 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a85eb921-2a96-4043-9815-f80307c33bbd tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:34.132115 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-a85eb921-2a96-4043-9815-f80307c33bbd tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:34.139708 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-a85eb921-2a96-4043-9815-f80307c33bbd tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23" status: 200 len: 1266 microversion: 2.1 time: 0.151017 Sep 21 12:32:34.140295 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 503/989] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:33 2022] GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:35.162933 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-54e46adb-c818-4452-b795-7a25957d037f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:35.163586 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-54e46adb-c818-4452-b795-7a25957d037f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:35.170246 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-54e46adb-c818-4452-b795-7a25957d037f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:35.170728 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-54e46adb-c818-4452-b795-7a25957d037f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:35.171161 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-54e46adb-c818-4452-b795-7a25957d037f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:35.171886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-54e46adb-c818-4452-b795-7a25957d037f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:35.172334 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-54e46adb-c818-4452-b795-7a25957d037f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:35.172760 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-54e46adb-c818-4452-b795-7a25957d037f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:35.302634 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-54e46adb-c818-4452-b795-7a25957d037f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:35.310640 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-54e46adb-c818-4452-b795-7a25957d037f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23" status: 200 len: 1266 microversion: 2.1 time: 0.151753 Sep 21 12:32:35.311220 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 487/990] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:35 2022] GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:36.332713 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-b52082ea-c678-4c40-b07d-97090b34727f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:36.333331 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-b52082ea-c678-4c40-b07d-97090b34727f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:36.335174 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell0:SELECT=2 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:32:36.336481 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell0:SELECT=8 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:32:36.343406 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b52082ea-c678-4c40-b07d-97090b34727f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:36.343928 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b52082ea-c678-4c40-b07d-97090b34727f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:36.344368 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b52082ea-c678-4c40-b07d-97090b34727f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:36.345071 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b52082ea-c678-4c40-b07d-97090b34727f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:36.345532 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b52082ea-c678-4c40-b07d-97090b34727f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:36.345973 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b52082ea-c678-4c40-b07d-97090b34727f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:36.481577 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-b52082ea-c678-4c40-b07d-97090b34727f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:36.489188 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-b52082ea-c678-4c40-b07d-97090b34727f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23" status: 200 len: 1266 microversion: 2.1 time: 0.160366 Sep 21 12:32:36.489749 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 504/991] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:36 2022] GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:37.512342 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-4b278627-13f9-4c8a-a9cd-042feb2e1c20 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:37.512896 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-4b278627-13f9-4c8a-a9cd-042feb2e1c20 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:37.519625 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4b278627-13f9-4c8a-a9cd-042feb2e1c20 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:37.520244 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4b278627-13f9-4c8a-a9cd-042feb2e1c20 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:37.520760 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4b278627-13f9-4c8a-a9cd-042feb2e1c20 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:37.521519 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4b278627-13f9-4c8a-a9cd-042feb2e1c20 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:37.521980 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4b278627-13f9-4c8a-a9cd-042feb2e1c20 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:37.522414 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4b278627-13f9-4c8a-a9cd-042feb2e1c20 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:37.656090 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-4b278627-13f9-4c8a-a9cd-042feb2e1c20 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:37.663798 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-4b278627-13f9-4c8a-a9cd-042feb2e1c20 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23" status: 200 len: 1266 microversion: 2.1 time: 0.155470 Sep 21 12:32:37.664426 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 488/992] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:37 2022] GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:38.686832 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-28f7d850-13a2-4837-ae94-13975320e47f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:38.687470 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-28f7d850-13a2-4837-ae94-13975320e47f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:38.693507 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-28f7d850-13a2-4837-ae94-13975320e47f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:38.693988 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-28f7d850-13a2-4837-ae94-13975320e47f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:38.694427 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-28f7d850-13a2-4837-ae94-13975320e47f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:38.695120 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-28f7d850-13a2-4837-ae94-13975320e47f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:38.695585 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-28f7d850-13a2-4837-ae94-13975320e47f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:38.696045 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-28f7d850-13a2-4837-ae94-13975320e47f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:38.828947 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-28f7d850-13a2-4837-ae94-13975320e47f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:38.837836 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-28f7d850-13a2-4837-ae94-13975320e47f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23" status: 200 len: 1266 microversion: 2.1 time: 0.155150 Sep 21 12:32:38.838417 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 505/993] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:38 2022] GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:39.862271 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-1ed6035f-c8b3-4b57-a9f7-31b6e147b19b tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:39.862897 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-1ed6035f-c8b3-4b57-a9f7-31b6e147b19b tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:39.865404 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:32:39.871256 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1ed6035f-c8b3-4b57-a9f7-31b6e147b19b tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:39.871740 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1ed6035f-c8b3-4b57-a9f7-31b6e147b19b tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:39.872216 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1ed6035f-c8b3-4b57-a9f7-31b6e147b19b tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:39.872930 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1ed6035f-c8b3-4b57-a9f7-31b6e147b19b tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:39.873393 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1ed6035f-c8b3-4b57-a9f7-31b6e147b19b tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:39.873831 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-1ed6035f-c8b3-4b57-a9f7-31b6e147b19b tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:40.007352 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-1ed6035f-c8b3-4b57-a9f7-31b6e147b19b tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:40.015926 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-1ed6035f-c8b3-4b57-a9f7-31b6e147b19b tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23" status: 200 len: 1266 microversion: 2.1 time: 0.157755 Sep 21 12:32:40.016432 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 489/994] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:39 2022] GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:40.402959 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-fac2d57a-48e0-4625-99be-bba2b8616ab3 req-b018f9e4-4ecf-48b3-b0bd-f79adacb9673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23", "name": "network-vif-plugged", "status": "completed", "tag": "30cdd6f9-678f-4f65-b2ab-284e35d1463a"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:32:40.412983 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-fac2d57a-48e0-4625-99be-bba2b8616ab3 req-b018f9e4-4ecf-48b3-b0bd-f79adacb9673 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:40.413494 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-fac2d57a-48e0-4625-99be-bba2b8616ab3 req-b018f9e4-4ecf-48b3-b0bd-f79adacb9673 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:40.413922 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-fac2d57a-48e0-4625-99be-bba2b8616ab3 req-b018f9e4-4ecf-48b3-b0bd-f79adacb9673 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:40.424531 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-fac2d57a-48e0-4625-99be-bba2b8616ab3 req-b018f9e4-4ecf-48b3-b0bd-f79adacb9673 service nova] Creating event network-vif-plugged:30cdd6f9-678f-4f65-b2ab-284e35d1463a for instance 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 on hv-cinder-85867 Sep 21 12:32:40.429648 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-fac2d57a-48e0-4625-99be-bba2b8616ab3 req-b018f9e4-4ecf-48b3-b0bd-f79adacb9673 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089921 Sep 21 12:32:40.430961 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 506/995] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:32:41.039015 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-d431b39d-4564-4c49-b00e-c751cbdfcd10 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:41.040199 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-d431b39d-4564-4c49-b00e-c751cbdfcd10 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:41.046646 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d431b39d-4564-4c49-b00e-c751cbdfcd10 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:41.047129 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d431b39d-4564-4c49-b00e-c751cbdfcd10 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:41.047575 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d431b39d-4564-4c49-b00e-c751cbdfcd10 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:41.048339 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d431b39d-4564-4c49-b00e-c751cbdfcd10 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:41.048803 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d431b39d-4564-4c49-b00e-c751cbdfcd10 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:41.049236 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d431b39d-4564-4c49-b00e-c751cbdfcd10 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:41.176387 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-d431b39d-4564-4c49-b00e-c751cbdfcd10 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:41.184162 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-d431b39d-4564-4c49-b00e-c751cbdfcd10 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23" status: 200 len: 1266 microversion: 2.1 time: 0.149047 Sep 21 12:32:41.184744 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 490/996] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:41 2022] GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:42.207924 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-0a72ec85-ab43-409a-875d-d7030301e8b6 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:42.208576 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-0a72ec85-ab43-409a-875d-d7030301e8b6 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:42.215905 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0a72ec85-ab43-409a-875d-d7030301e8b6 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:42.216395 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0a72ec85-ab43-409a-875d-d7030301e8b6 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:42.216839 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0a72ec85-ab43-409a-875d-d7030301e8b6 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:42.217540 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0a72ec85-ab43-409a-875d-d7030301e8b6 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:42.217999 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0a72ec85-ab43-409a-875d-d7030301e8b6 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:42.218430 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0a72ec85-ab43-409a-875d-d7030301e8b6 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:42.352758 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-0a72ec85-ab43-409a-875d-d7030301e8b6 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:42.360405 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-0a72ec85-ab43-409a-875d-d7030301e8b6 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23" status: 200 len: 1266 microversion: 2.1 time: 0.157130 Sep 21 12:32:42.360969 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 507/997] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:42 2022] GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:43.383152 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-82dc700c-907a-4aa3-8e82-220143c031ea tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:43.383813 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-82dc700c-907a-4aa3-8e82-220143c031ea tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:43.390578 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-82dc700c-907a-4aa3-8e82-220143c031ea tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:43.391080 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-82dc700c-907a-4aa3-8e82-220143c031ea tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:43.391612 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-82dc700c-907a-4aa3-8e82-220143c031ea tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:43.392362 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-82dc700c-907a-4aa3-8e82-220143c031ea tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:43.392828 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-82dc700c-907a-4aa3-8e82-220143c031ea tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:43.393265 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-82dc700c-907a-4aa3-8e82-220143c031ea tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:43.527568 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-82dc700c-907a-4aa3-8e82-220143c031ea tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:43.535348 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-82dc700c-907a-4aa3-8e82-220143c031ea tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23" status: 200 len: 1454 microversion: 2.1 time: 0.156119 Sep 21 12:32:43.535955 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 491/998] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:43 2022] GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:43.557709 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-dafe6ca4-706e-40f7-b698-2129f7787827 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:43.558307 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-dafe6ca4-706e-40f7-b698-2129f7787827 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:43.564620 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dafe6ca4-706e-40f7-b698-2129f7787827 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:43.565096 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dafe6ca4-706e-40f7-b698-2129f7787827 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:43.565523 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dafe6ca4-706e-40f7-b698-2129f7787827 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:43.566203 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dafe6ca4-706e-40f7-b698-2129f7787827 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:43.566656 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dafe6ca4-706e-40f7-b698-2129f7787827 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:43.567075 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dafe6ca4-706e-40f7-b698-2129f7787827 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:43.697580 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-dafe6ca4-706e-40f7-b698-2129f7787827 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:32:43.705648 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-dafe6ca4-706e-40f7-b698-2129f7787827 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23" status: 200 len: 1454 microversion: 2.1 time: 0.151753 Sep 21 12:32:43.706218 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 508/999] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:32:43 2022] GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:32:45.341027 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-c38ad27b-b56d-4cc7-883d-db5ee1f3249b req-3b5b6d6d-ad43-4e02-83d6-c6b3ddffc494 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23", "tag": "30cdd6f9-678f-4f65-b2ab-284e35d1463a"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:32:45.350776 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-c38ad27b-b56d-4cc7-883d-db5ee1f3249b req-3b5b6d6d-ad43-4e02-83d6-c6b3ddffc494 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:45.351265 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-c38ad27b-b56d-4cc7-883d-db5ee1f3249b req-3b5b6d6d-ad43-4e02-83d6-c6b3ddffc494 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:45.351701 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-c38ad27b-b56d-4cc7-883d-db5ee1f3249b req-3b5b6d6d-ad43-4e02-83d6-c6b3ddffc494 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:45.365549 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-c38ad27b-b56d-4cc7-883d-db5ee1f3249b req-3b5b6d6d-ad43-4e02-83d6-c6b3ddffc494 service nova] Creating event network-changed:30cdd6f9-678f-4f65-b2ab-284e35d1463a for instance 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 on hv-cinder-85867 Sep 21 12:32:45.371305 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-c38ad27b-b56d-4cc7-883d-db5ee1f3249b req-3b5b6d6d-ad43-4e02-83d6-c6b3ddffc494 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034130 Sep 21 12:32:45.372036 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 492/1000] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:32:54.906107 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-de46e8ec-cc8a-4c5b-8d6d-c140144081fd tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:32:54.906683 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-de46e8ec-cc8a-4c5b-8d6d-c140144081fd tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: e17630cc-94bc-4b00-a64e-3c092f04cb1a] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:54.909506 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_api:SELECT=21 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:32:54.910169 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=61 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:32:54.916162 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-de46e8ec-cc8a-4c5b-8d6d-c140144081fd tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:54.916653 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-de46e8ec-cc8a-4c5b-8d6d-c140144081fd tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:54.917097 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-de46e8ec-cc8a-4c5b-8d6d-c140144081fd tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:54.917801 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-de46e8ec-cc8a-4c5b-8d6d-c140144081fd tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:54.918599 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-de46e8ec-cc8a-4c5b-8d6d-c140144081fd tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:54.918732 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-de46e8ec-cc8a-4c5b-8d6d-c140144081fd tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:54.942233 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-de46e8ec-cc8a-4c5b-8d6d-c140144081fd tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a/ips" status: 200 len: 148 microversion: 2.1 time: 0.040176 Sep 21 12:32:54.942807 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 509/1001] 10.222.0.71 () {58 vars in 1248 bytes} [Wed Sep 21 12:32:54 2022] GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a/ips => generated 148 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:32:56.312767 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=7 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:32:56.313591 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=65 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:32:56.318179 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-e00858cc-ac29-4b97-bed9-1d17f2af055f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15a3aec3-c68d-479e-badf-340f53061128"}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:32:56.320685 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-e00858cc-ac29-4b97-bed9-1d17f2af055f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: e17630cc-94bc-4b00-a64e-3c092f04cb1a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:32:56.328311 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e00858cc-ac29-4b97-bed9-1d17f2af055f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:56.329059 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e00858cc-ac29-4b97-bed9-1d17f2af055f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:56.329498 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e00858cc-ac29-4b97-bed9-1d17f2af055f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:56.330198 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e00858cc-ac29-4b97-bed9-1d17f2af055f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:32:56.330656 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e00858cc-ac29-4b97-bed9-1d17f2af055f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:32:56.331086 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e00858cc-ac29-4b97-bed9-1d17f2af055f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:32:56.614251 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-e00858cc-ac29-4b97-bed9-1d17f2af055f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "POST /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302860 Sep 21 12:32:56.621203 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 493/1002] 10.222.0.71 () {60 vars in 1323 bytes} [Wed Sep 21 12:32:56 2022] POST /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:33:04.177046 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-48991fdd-a0e9-4a15-9c8c-78f4518e0da4 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Action: 'create', calling method: .version_select at 0x7fe4cc61cd30>, body: {"keypair": {"name": "tempest-keypair-1004733291", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsPP2cOCa4GEswi41+qFOQYOGIlaUd1D/IxRuqs8R9PSrtDK7xCGGSGGoAKi2mGJJYiqXu5xCmQHTa2vNwpkiI+OE8Li4HTn60ZZi3++aoTGx8ug9YMQKpCM2evlbiSlw=="}} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:33:04.192684 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-48991fdd-a0e9-4a15-9c8c-78f4518e0da4 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Getting quotas for project bd7f2ef25e054b619068baf878bead18. Resources: {'key_pairs'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 12:33:04.196593 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-48991fdd-a0e9-4a15-9c8c-78f4518e0da4 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Getting quotas for user 90d4dfe489634f3c9346b0ab86408e3b and project bd7f2ef25e054b619068baf878bead18. Resources: {'key_pairs'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 12:33:04.219338 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-48991fdd-a0e9-4a15-9c8c-78f4518e0da4 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046217 Sep 21 12:33:04.219971 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 510/1003] 10.222.0.71 () {60 vars in 1159 bytes} [Wed Sep 21 12:33:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:33:05.541880 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-5d68dd03-22f5-4074-8fb4-e5bbe0dd343f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1810385932", "imageRef": "1e3a8d95-6338-499c-af91-e3d1345af950", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8f74bce-cdd1-4f64-9fe4-35f38581a3e4"}], "security_groups": [{"name": "tempest-securitygroup--1609582128"}], "key_name": "tempest-keypair-1004733291", "user_data": "}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:33:05.652433 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.network.neutron [None req-5d68dd03-22f5-4074-8fb4-e5bbe0dd343f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] validate_networks() for [('e8f74bce-cdd1-4f64-9fe4-35f38581a3e4', None, None, None, None, None)] {{(pid=120463) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 12:33:06.039749 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-5d68dd03-22f5-4074-8fb4-e5bbe0dd343f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Flavor limits 0:0:0 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 12:33:06.041049 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-5d68dd03-22f5-4074-8fb4-e5bbe0dd343f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Image limits 0:0:0 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 12:33:06.041869 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-5d68dd03-22f5-4074-8fb4-e5bbe0dd343f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Flavor pref 0:0:0 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 12:33:06.042582 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-5d68dd03-22f5-4074-8fb4-e5bbe0dd343f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Image pref 0:0:0 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 12:33:06.043338 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-5d68dd03-22f5-4074-8fb4-e5bbe0dd343f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 12:33:06.058301 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5d68dd03-22f5-4074-8fb4-e5bbe0dd343f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:33:06.059142 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5d68dd03-22f5-4074-8fb4-e5bbe0dd343f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:33:06.060529 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5d68dd03-22f5-4074-8fb4-e5bbe0dd343f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:33:06.061281 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5d68dd03-22f5-4074-8fb4-e5bbe0dd343f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:33:06.062097 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5d68dd03-22f5-4074-8fb4-e5bbe0dd343f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:33:06.062861 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5d68dd03-22f5-4074-8fb4-e5bbe0dd343f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:33:06.092060 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.quota [None req-5d68dd03-22f5-4074-8fb4-e5bbe0dd343f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Getting quotas for project bd7f2ef25e054b619068baf878bead18. Resources: {'instances', 'ram', 'cores'} {{(pid=120463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 12:33:06.098802 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.quota [None req-5d68dd03-22f5-4074-8fb4-e5bbe0dd343f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Getting quotas for user 90d4dfe489634f3c9346b0ab86408e3b and project bd7f2ef25e054b619068baf878bead18. Resources: {'instances', 'ram', 'cores'} {{(pid=120463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 12:33:06.117539 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-5d68dd03-22f5-4074-8fb4-e5bbe0dd343f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Going to run 1 instances... {{(pid=120463) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 12:33:06.122611 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-5d68dd03-22f5-4074-8fb4-e5bbe0dd343f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 136bd64b-32e2-4d7c-b864-99becaf61714] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e3a8d95-6338-499c-af91-e3d1345af950',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 12:33:06.186968 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-5d68dd03-22f5-4074-8fb4-e5bbe0dd343f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.651120 Sep 21 12:33:06.188166 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 494/1004] 10.222.0.71 () {60 vars in 1147 bytes} [Wed Sep 21 12:33:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 21 12:33:06.196972 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=4 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:33:06.203788 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-5fd640b9-cd4f-4eab-9cd2-51df72359fa3 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:33:06.205480 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-5fd640b9-cd4f-4eab-9cd2-51df72359fa3 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 136bd64b-32e2-4d7c-b864-99becaf61714] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:33:06.266727 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-5fd640b9-cd4f-4eab-9cd2-51df72359fa3 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:33:06.273560 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-5fd640b9-cd4f-4eab-9cd2-51df72359fa3 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714" status: 200 len: 1242 microversion: 2.1 time: 0.078132 Sep 21 12:33:06.274139 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 511/1005] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:33:06 2022] GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714 => generated 1242 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:33:07.296989 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-a5e93e3e-1032-4fba-acf2-900387dff9fa tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:33:07.297545 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-a5e93e3e-1032-4fba-acf2-900387dff9fa tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 136bd64b-32e2-4d7c-b864-99becaf61714] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:33:07.305225 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a5e93e3e-1032-4fba-acf2-900387dff9fa tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:33:07.305725 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a5e93e3e-1032-4fba-acf2-900387dff9fa tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:33:07.306699 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a5e93e3e-1032-4fba-acf2-900387dff9fa tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:33:07.307380 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a5e93e3e-1032-4fba-acf2-900387dff9fa tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:33:07.307872 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a5e93e3e-1032-4fba-acf2-900387dff9fa tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:33:07.308342 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a5e93e3e-1032-4fba-acf2-900387dff9fa tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:33:07.375422 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a5e93e3e-1032-4fba-acf2-900387dff9fa tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:33:07.383292 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-a5e93e3e-1032-4fba-acf2-900387dff9fa tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714" status: 200 len: 1294 microversion: 2.1 time: 0.090838 Sep 21 12:33:07.383985 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 495/1006] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:33:07 2022] GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714 => generated 1294 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:33:08.407155 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-3a322907-5005-4535-a275-8da92486af21 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:33:08.407794 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-3a322907-5005-4535-a275-8da92486af21 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 136bd64b-32e2-4d7c-b864-99becaf61714] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:33:08.414520 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3a322907-5005-4535-a275-8da92486af21 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:33:08.415015 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3a322907-5005-4535-a275-8da92486af21 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:33:08.415521 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3a322907-5005-4535-a275-8da92486af21 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:33:08.416836 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3a322907-5005-4535-a275-8da92486af21 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:33:08.416836 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3a322907-5005-4535-a275-8da92486af21 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:33:08.417160 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3a322907-5005-4535-a275-8da92486af21 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:33:08.633293 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-3a322907-5005-4535-a275-8da92486af21 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:33:08.645747 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-3a322907-5005-4535-a275-8da92486af21 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714" status: 200 len: 1368 microversion: 2.1 time: 0.241229 Sep 21 12:33:08.646626 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 512/1007] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:33:08 2022] GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714 => generated 1368 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:33:09.035098 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-14c637ce-4601-47bc-b2e3-510d568feb25 req-17d1d2a4-8011-4c96-842d-7456c9b92166 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "136bd64b-32e2-4d7c-b864-99becaf61714", "tag": "7ae2d2df-8a27-44be-8c47-a003fdd11c3a"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:33:09.048377 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-14c637ce-4601-47bc-b2e3-510d568feb25 req-17d1d2a4-8011-4c96-842d-7456c9b92166 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:33:09.048876 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-14c637ce-4601-47bc-b2e3-510d568feb25 req-17d1d2a4-8011-4c96-842d-7456c9b92166 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:33:09.049335 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-14c637ce-4601-47bc-b2e3-510d568feb25 req-17d1d2a4-8011-4c96-842d-7456c9b92166 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:33:09.064972 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-14c637ce-4601-47bc-b2e3-510d568feb25 req-17d1d2a4-8011-4c96-842d-7456c9b92166 service nova] Creating event network-changed:7ae2d2df-8a27-44be-8c47-a003fdd11c3a for instance 136bd64b-32e2-4d7c-b864-99becaf61714 on hv-cinder-85867 Sep 21 12:33:09.070333 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-14c637ce-4601-47bc-b2e3-510d568feb25 req-17d1d2a4-8011-4c96-842d-7456c9b92166 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039192 Sep 21 12:33:09.071130 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 496/1008] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:33:09.668971 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-2c3effd6-e386-4157-8c7c-e3e0611bfc09 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:33:09.669570 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-2c3effd6-e386-4157-8c7c-e3e0611bfc09 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 136bd64b-32e2-4d7c-b864-99becaf61714] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:33:09.676025 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2c3effd6-e386-4157-8c7c-e3e0611bfc09 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:33:09.676510 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2c3effd6-e386-4157-8c7c-e3e0611bfc09 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:33:09.676944 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2c3effd6-e386-4157-8c7c-e3e0611bfc09 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:33:09.677642 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2c3effd6-e386-4157-8c7c-e3e0611bfc09 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:33:09.678088 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2c3effd6-e386-4157-8c7c-e3e0611bfc09 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:33:09.678505 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2c3effd6-e386-4157-8c7c-e3e0611bfc09 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:33:09.811573 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-2c3effd6-e386-4157-8c7c-e3e0611bfc09 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:33:09.819384 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-2c3effd6-e386-4157-8c7c-e3e0611bfc09 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714" status: 200 len: 1368 microversion: 2.1 time: 0.154879 Sep 21 12:33:09.819989 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 513/1009] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:33:09 2022] GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:33:10.843919 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-f5cc444e-1be5-4274-bf12-0b35ba639842 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:33:10.844623 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-f5cc444e-1be5-4274-bf12-0b35ba639842 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 136bd64b-32e2-4d7c-b864-99becaf61714] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:33:10.850880 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f5cc444e-1be5-4274-bf12-0b35ba639842 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:33:10.851362 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f5cc444e-1be5-4274-bf12-0b35ba639842 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:33:10.851823 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f5cc444e-1be5-4274-bf12-0b35ba639842 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:33:10.852523 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f5cc444e-1be5-4274-bf12-0b35ba639842 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:33:10.853470 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f5cc444e-1be5-4274-bf12-0b35ba639842 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:33:10.853892 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f5cc444e-1be5-4274-bf12-0b35ba639842 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:33:10.985786 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-f5cc444e-1be5-4274-bf12-0b35ba639842 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:33:10.993884 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-f5cc444e-1be5-4274-bf12-0b35ba639842 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714" status: 200 len: 1368 microversion: 2.1 time: 0.154606 Sep 21 12:33:10.994467 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 497/1010] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:33:10 2022] GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:33:12.016562 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-dbcc8993-a455-47f0-bdff-3cd70aab9c80 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:33:12.017182 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-dbcc8993-a455-47f0-bdff-3cd70aab9c80 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 136bd64b-32e2-4d7c-b864-99becaf61714] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:33:12.023704 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dbcc8993-a455-47f0-bdff-3cd70aab9c80 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:33:12.024250 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dbcc8993-a455-47f0-bdff-3cd70aab9c80 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:33:12.024749 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dbcc8993-a455-47f0-bdff-3cd70aab9c80 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:33:12.025457 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dbcc8993-a455-47f0-bdff-3cd70aab9c80 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:33:12.025910 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dbcc8993-a455-47f0-bdff-3cd70aab9c80 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:33:12.026341 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dbcc8993-a455-47f0-bdff-3cd70aab9c80 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:33:12.230898 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-dbcc8993-a455-47f0-bdff-3cd70aab9c80 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:33:12.238582 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-dbcc8993-a455-47f0-bdff-3cd70aab9c80 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714" status: 200 len: 1368 microversion: 2.1 time: 0.225868 Sep 21 12:33:12.239170 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 514/1011] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:33:12 2022] GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714 => generated 1368 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:33:13.262955 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-dad79462-e3bc-4a4d-8419-b039530cae47 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:33:13.263637 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-dad79462-e3bc-4a4d-8419-b039530cae47 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 136bd64b-32e2-4d7c-b864-99becaf61714] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:33:13.270036 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dad79462-e3bc-4a4d-8419-b039530cae47 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:33:13.270525 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dad79462-e3bc-4a4d-8419-b039530cae47 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:33:13.270962 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dad79462-e3bc-4a4d-8419-b039530cae47 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:33:13.271683 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dad79462-e3bc-4a4d-8419-b039530cae47 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:33:13.272151 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dad79462-e3bc-4a4d-8419-b039530cae47 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:33:13.272585 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dad79462-e3bc-4a4d-8419-b039530cae47 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:33:13.405617 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-dad79462-e3bc-4a4d-8419-b039530cae47 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:33:13.413621 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-dad79462-e3bc-4a4d-8419-b039530cae47 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714" status: 200 len: 1368 microversion: 2.1 time: 0.155189 Sep 21 12:33:13.414206 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 498/1012] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:33:13 2022] GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:33:14.438032 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-bb6e3aa9-f6a3-47dd-82ce-a2c432315b8c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:33:14.438645 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-bb6e3aa9-f6a3-47dd-82ce-a2c432315b8c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 136bd64b-32e2-4d7c-b864-99becaf61714] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:33:14.440294 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-a06318d1-508a-4c46-ab39-1acd8112fa34 req-fcd3d9e2-de2a-4488-a566-a1e8b04a9a97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "136bd64b-32e2-4d7c-b864-99becaf61714", "name": "network-vif-plugged", "status": "completed", "tag": "7ae2d2df-8a27-44be-8c47-a003fdd11c3a"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:33:14.445645 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bb6e3aa9-f6a3-47dd-82ce-a2c432315b8c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:33:14.446346 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bb6e3aa9-f6a3-47dd-82ce-a2c432315b8c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:33:14.446862 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bb6e3aa9-f6a3-47dd-82ce-a2c432315b8c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:33:14.447792 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bb6e3aa9-f6a3-47dd-82ce-a2c432315b8c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:33:14.448324 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bb6e3aa9-f6a3-47dd-82ce-a2c432315b8c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:33:14.448834 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bb6e3aa9-f6a3-47dd-82ce-a2c432315b8c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:33:14.452655 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-a06318d1-508a-4c46-ab39-1acd8112fa34 req-fcd3d9e2-de2a-4488-a566-a1e8b04a9a97 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:33:14.453241 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-a06318d1-508a-4c46-ab39-1acd8112fa34 req-fcd3d9e2-de2a-4488-a566-a1e8b04a9a97 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:33:14.453752 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-a06318d1-508a-4c46-ab39-1acd8112fa34 req-fcd3d9e2-de2a-4488-a566-a1e8b04a9a97 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:33:14.465521 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-a06318d1-508a-4c46-ab39-1acd8112fa34 req-fcd3d9e2-de2a-4488-a566-a1e8b04a9a97 service nova] Creating event network-vif-plugged:7ae2d2df-8a27-44be-8c47-a003fdd11c3a for instance 136bd64b-32e2-4d7c-b864-99becaf61714 on hv-cinder-85867 Sep 21 12:33:14.470788 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-a06318d1-508a-4c46-ab39-1acd8112fa34 req-fcd3d9e2-de2a-4488-a566-a1e8b04a9a97 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034171 Sep 21 12:33:14.471677 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 499/1013] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:33:14.594960 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-bb6e3aa9-f6a3-47dd-82ce-a2c432315b8c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:33:14.604022 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-bb6e3aa9-f6a3-47dd-82ce-a2c432315b8c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714" status: 200 len: 1368 microversion: 2.1 time: 0.170026 Sep 21 12:33:14.604932 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 515/1014] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:33:14 2022] GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:33:15.635865 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-0d3a999d-545c-4a29-84ff-6999a9c5de5b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:33:15.636602 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-0d3a999d-545c-4a29-84ff-6999a9c5de5b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 136bd64b-32e2-4d7c-b864-99becaf61714] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:33:15.643415 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0d3a999d-545c-4a29-84ff-6999a9c5de5b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:33:15.643948 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0d3a999d-545c-4a29-84ff-6999a9c5de5b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:33:15.644401 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0d3a999d-545c-4a29-84ff-6999a9c5de5b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:33:15.645124 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0d3a999d-545c-4a29-84ff-6999a9c5de5b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:33:15.645583 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0d3a999d-545c-4a29-84ff-6999a9c5de5b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:33:15.646070 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0d3a999d-545c-4a29-84ff-6999a9c5de5b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:33:15.788844 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-0d3a999d-545c-4a29-84ff-6999a9c5de5b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:33:15.798828 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-0d3a999d-545c-4a29-84ff-6999a9c5de5b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714" status: 200 len: 1368 microversion: 2.1 time: 0.171968 Sep 21 12:33:15.799425 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 500/1015] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:33:15 2022] GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:33:16.829246 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-69bd5387-84c5-4a40-9ac8-1bdedcc0004a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:33:16.830036 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-69bd5387-84c5-4a40-9ac8-1bdedcc0004a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 136bd64b-32e2-4d7c-b864-99becaf61714] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:33:16.832667 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell0:SELECT=6 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:33:16.838784 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-69bd5387-84c5-4a40-9ac8-1bdedcc0004a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:33:16.839266 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-69bd5387-84c5-4a40-9ac8-1bdedcc0004a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:33:16.839699 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-69bd5387-84c5-4a40-9ac8-1bdedcc0004a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:33:16.840436 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-69bd5387-84c5-4a40-9ac8-1bdedcc0004a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:33:16.840883 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-69bd5387-84c5-4a40-9ac8-1bdedcc0004a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:33:16.841300 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-69bd5387-84c5-4a40-9ac8-1bdedcc0004a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:33:16.969440 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-69bd5387-84c5-4a40-9ac8-1bdedcc0004a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:33:16.978062 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-69bd5387-84c5-4a40-9ac8-1bdedcc0004a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714" status: 200 len: 1557 microversion: 2.1 time: 0.153258 Sep 21 12:33:16.978642 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 516/1016] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:33:16 2022] GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:33:17.002400 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-899732df-c3e3-483a-8333-bc6fbbda5731 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:33:17.002988 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-899732df-c3e3-483a-8333-bc6fbbda5731 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 136bd64b-32e2-4d7c-b864-99becaf61714] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:33:17.004936 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell0:SELECT=2 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:33:17.005618 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell0:SELECT=6 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:33:17.013108 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-899732df-c3e3-483a-8333-bc6fbbda5731 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:33:17.013604 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-899732df-c3e3-483a-8333-bc6fbbda5731 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:33:17.014059 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-899732df-c3e3-483a-8333-bc6fbbda5731 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:33:17.014764 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-899732df-c3e3-483a-8333-bc6fbbda5731 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:33:17.015227 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-899732df-c3e3-483a-8333-bc6fbbda5731 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:33:17.015665 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-899732df-c3e3-483a-8333-bc6fbbda5731 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:33:17.098245 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-899732df-c3e3-483a-8333-bc6fbbda5731 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100401 Sep 21 12:33:17.098848 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 501/1017] 10.222.0.71 () {58 vars in 1275 bytes} [Wed Sep 21 12:33:16 2022] GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:33:18.342947 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-4df625f2-4e0c-43e4-a707-3170cc4697f2 req-7be85a60-4b3c-4c6a-a6ae-7842cfdf409e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "136bd64b-32e2-4d7c-b864-99becaf61714", "tag": "7ae2d2df-8a27-44be-8c47-a003fdd11c3a"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:33:18.353968 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-4df625f2-4e0c-43e4-a707-3170cc4697f2 req-7be85a60-4b3c-4c6a-a6ae-7842cfdf409e service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:33:18.354455 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-4df625f2-4e0c-43e4-a707-3170cc4697f2 req-7be85a60-4b3c-4c6a-a6ae-7842cfdf409e service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:33:18.354895 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-4df625f2-4e0c-43e4-a707-3170cc4697f2 req-7be85a60-4b3c-4c6a-a6ae-7842cfdf409e service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:33:18.367743 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-4df625f2-4e0c-43e4-a707-3170cc4697f2 req-7be85a60-4b3c-4c6a-a6ae-7842cfdf409e service nova] Creating event network-changed:7ae2d2df-8a27-44be-8c47-a003fdd11c3a for instance 136bd64b-32e2-4d7c-b864-99becaf61714 on hv-cinder-85867 Sep 21 12:33:18.374295 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-4df625f2-4e0c-43e4-a707-3170cc4697f2 req-7be85a60-4b3c-4c6a-a6ae-7842cfdf409e service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034834 Sep 21 12:33:18.375028 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 517/1018] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:34:09.189129 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:34:09.193153 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:34:09.194100 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:34:09.198728 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-fd9a022c-bea8-4392-9a88-eba812c170f5 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:09.199295 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-fd9a022c-bea8-4392-9a88-eba812c170f5 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:34:09.204586 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=32 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:34:09.209228 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-03180ffd-43f1-4f81-b568-6c21c8630baf req-c1b952a8-057d-4199-8eaf-b631648b90bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66e9cb90-c71a-420a-b647-991844d5c17c", "tag": "15af239b-da86-43fe-81e4-6adb2158f5c6"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:34:09.220067 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fd9a022c-bea8-4392-9a88-eba812c170f5 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:09.220567 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fd9a022c-bea8-4392-9a88-eba812c170f5 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:09.221011 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fd9a022c-bea8-4392-9a88-eba812c170f5 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:09.221731 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fd9a022c-bea8-4392-9a88-eba812c170f5 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:09.222209 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fd9a022c-bea8-4392-9a88-eba812c170f5 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:09.222616 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-fd9a022c-bea8-4392-9a88-eba812c170f5 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:09.232691 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-03180ffd-43f1-4f81-b568-6c21c8630baf req-c1b952a8-057d-4199-8eaf-b631648b90bd service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:09.233176 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-03180ffd-43f1-4f81-b568-6c21c8630baf req-c1b952a8-057d-4199-8eaf-b631648b90bd service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:09.233610 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-03180ffd-43f1-4f81-b568-6c21c8630baf req-c1b952a8-057d-4199-8eaf-b631648b90bd service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:09.245647 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-03180ffd-43f1-4f81-b568-6c21c8630baf req-c1b952a8-057d-4199-8eaf-b631648b90bd service nova] Creating event network-changed:15af239b-da86-43fe-81e4-6adb2158f5c6 for instance 66e9cb90-c71a-420a-b647-991844d5c17c on hv-cinder-85867 Sep 21 12:34:09.251432 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-03180ffd-43f1-4f81-b568-6c21c8630baf req-c1b952a8-057d-4199-8eaf-b631648b90bd service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060209 Sep 21 12:34:09.251629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-fd9a022c-bea8-4392-9a88-eba812c170f5 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Going to try to terminate instance {{(pid=120463) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 12:34:09.252068 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 518/1019] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:34:09.341390 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-fd9a022c-bea8-4392-9a88-eba812c170f5 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "DELETE /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 204 len: 0 microversion: 2.1 time: 0.153444 Sep 21 12:34:09.342796 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 502/1020] 10.222.0.71 () {58 vars in 1239 bytes} [Wed Sep 21 12:34:09 2022] DELETE /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 21 12:34:09.354517 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-3ce08b17-94c7-4364-9312-1e687ae756a4 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:09.357065 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-3ce08b17-94c7-4364-9312-1e687ae756a4 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:34:09.365885 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3ce08b17-94c7-4364-9312-1e687ae756a4 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:09.366623 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3ce08b17-94c7-4364-9312-1e687ae756a4 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:09.367056 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3ce08b17-94c7-4364-9312-1e687ae756a4 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:09.367786 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3ce08b17-94c7-4364-9312-1e687ae756a4 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:09.368293 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3ce08b17-94c7-4364-9312-1e687ae756a4 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:09.368714 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3ce08b17-94c7-4364-9312-1e687ae756a4 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:09.507184 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-3ce08b17-94c7-4364-9312-1e687ae756a4 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:34:09.515355 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-3ce08b17-94c7-4364-9312-1e687ae756a4 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1566 microversion: 2.1 time: 0.167969 Sep 21 12:34:09.515996 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 519/1021] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:34:09 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:34:10.540703 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-a7d3051f-7771-408c-8ac7-68bd2e8916cc tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:10.541323 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-a7d3051f-7771-408c-8ac7-68bd2e8916cc tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:34:10.548211 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a7d3051f-7771-408c-8ac7-68bd2e8916cc tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:10.548698 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a7d3051f-7771-408c-8ac7-68bd2e8916cc tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:10.549131 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a7d3051f-7771-408c-8ac7-68bd2e8916cc tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:10.549829 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a7d3051f-7771-408c-8ac7-68bd2e8916cc tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:10.550277 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a7d3051f-7771-408c-8ac7-68bd2e8916cc tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:10.550703 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a7d3051f-7771-408c-8ac7-68bd2e8916cc tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:10.688908 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a7d3051f-7771-408c-8ac7-68bd2e8916cc tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:34:10.696759 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-a7d3051f-7771-408c-8ac7-68bd2e8916cc tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1566 microversion: 2.1 time: 0.160408 Sep 21 12:34:10.697344 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 503/1022] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:34:10 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:34:11.719716 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-f620a834-7ecc-454e-a339-f399b9689770 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:11.720489 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-f620a834-7ecc-454e-a339-f399b9689770 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:34:11.727995 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f620a834-7ecc-454e-a339-f399b9689770 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:11.728498 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f620a834-7ecc-454e-a339-f399b9689770 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:11.728948 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f620a834-7ecc-454e-a339-f399b9689770 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:11.729665 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f620a834-7ecc-454e-a339-f399b9689770 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:11.730127 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f620a834-7ecc-454e-a339-f399b9689770 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:11.730765 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f620a834-7ecc-454e-a339-f399b9689770 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:11.780305 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-7f167f97-9e03-49dc-b49e-155a1ad4c34c req-3ceffea5-79c8-498a-8df5-897e588ebf77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66e9cb90-c71a-420a-b647-991844d5c17c", "name": "network-vif-deleted", "tag": "15af239b-da86-43fe-81e4-6adb2158f5c6"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:34:11.794803 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-7f167f97-9e03-49dc-b49e-155a1ad4c34c req-3ceffea5-79c8-498a-8df5-897e588ebf77 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:11.795291 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-7f167f97-9e03-49dc-b49e-155a1ad4c34c req-3ceffea5-79c8-498a-8df5-897e588ebf77 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:11.795730 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-7f167f97-9e03-49dc-b49e-155a1ad4c34c req-3ceffea5-79c8-498a-8df5-897e588ebf77 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:11.810467 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-f620a834-7ecc-454e-a339-f399b9689770 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:34:11.811012 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-7f167f97-9e03-49dc-b49e-155a1ad4c34c req-3ceffea5-79c8-498a-8df5-897e588ebf77 service nova] Creating event network-vif-deleted:15af239b-da86-43fe-81e4-6adb2158f5c6 for instance 66e9cb90-c71a-420a-b647-991844d5c17c on hv-cinder-85867 Sep 21 12:34:11.816737 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-7f167f97-9e03-49dc-b49e-155a1ad4c34c req-3ceffea5-79c8-498a-8df5-897e588ebf77 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040874 Sep 21 12:34:11.817360 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 504/1023] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 12:34:11.821269 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-f620a834-7ecc-454e-a339-f399b9689770 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1380 microversion: 2.1 time: 0.105405 Sep 21 12:34:11.821845 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 520/1024] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:34:11 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1380 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:34:12.846571 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-40d8a3e8-af47-43c0-b2ec-94486db8591e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:12.847200 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-40d8a3e8-af47-43c0-b2ec-94486db8591e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:34:12.853364 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-40d8a3e8-af47-43c0-b2ec-94486db8591e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:12.853861 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-40d8a3e8-af47-43c0-b2ec-94486db8591e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:12.854287 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-40d8a3e8-af47-43c0-b2ec-94486db8591e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:12.854976 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-40d8a3e8-af47-43c0-b2ec-94486db8591e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:12.855482 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-40d8a3e8-af47-43c0-b2ec-94486db8591e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:12.855943 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-40d8a3e8-af47-43c0-b2ec-94486db8591e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:12.890502 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-40d8a3e8-af47-43c0-b2ec-94486db8591e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:12.891677 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-40d8a3e8-af47-43c0-b2ec-94486db8591e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:12.892256 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-40d8a3e8-af47-43c0-b2ec-94486db8591e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:12.892790 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.objects.instance [None req-40d8a3e8-af47-43c0-b2ec-94486db8591e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lazy-loading 'fault' on Instance uuid 66e9cb90-c71a-420a-b647-991844d5c17c {{(pid=120463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 12:34:12.935361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-40d8a3e8-af47-43c0-b2ec-94486db8591e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c4cdfb0f264398a7d3b155a9523b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95515a2858124583ac138aa6350e4bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:34:12.943821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-40d8a3e8-af47-43c0-b2ec-94486db8591e tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 200 len: 1223 microversion: 2.1 time: 0.102059 Sep 21 12:34:12.944405 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 505/1025] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:34:12 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 1223 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:34:13.968137 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-98960045-bd5e-4d23-92d0-b63e68a264c8 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:13.968758 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-98960045-bd5e-4d23-92d0-b63e68a264c8 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] [instance: 66e9cb90-c71a-420a-b647-991844d5c17c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:34:13.975186 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-98960045-bd5e-4d23-92d0-b63e68a264c8 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:13.975676 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-98960045-bd5e-4d23-92d0-b63e68a264c8 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:13.976151 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-98960045-bd5e-4d23-92d0-b63e68a264c8 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:13.976850 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-98960045-bd5e-4d23-92d0-b63e68a264c8 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:13.977311 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-98960045-bd5e-4d23-92d0-b63e68a264c8 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:13.977742 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-98960045-bd5e-4d23-92d0-b63e68a264c8 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:13.991486 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.wsgi [None req-98960045-bd5e-4d23-92d0-b63e68a264c8 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] HTTP exception thrown: Instance 66e9cb90-c71a-420a-b647-991844d5c17c could not be found. Sep 21 12:34:13.993217 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-98960045-bd5e-4d23-92d0-b63e68a264c8 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Request method failure captured: Sep 21 12:34:13.993217 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: request: GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c HTTP/1.1 Sep 21 12:34:13.993217 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept: application/json Sep 21 12:34:13.993217 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept-Encoding: identity Sep 21 12:34:13.993217 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Connection: close Sep 21 12:34:13.993217 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Length: 0 Sep 21 12:34:13.993217 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Type: application/json Sep 21 12:34:13.993217 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Host: 10.222.0.71 Sep 21 12:34:13.993217 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Openstack-System-Scope: None Sep 21 12:34:13.993217 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: User-Agent: python-urllib3/1.26.12 Sep 21 12:34:13.993217 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Auth-Token: gAAAAABjKwNudlBxghSKqf9-vKOUtsP0DostBWXN8PrldOvDb-LhRb5Z0S94JqJeuVtnySfWFy6Lu3U_ZBO-dd0eD9eCqCoQNzPfr5Jl-chKNBod4dBwysX-XqqJUoE6uzE_sLtvQ9jDuyzhro_R3VwgltropONg5hu8IOpciz8CdOtPvkFNwjU Sep 21 12:34:13.993217 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Id: None Sep 21 12:34:13.993217 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Name: None Sep 21 12:34:13.993217 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Identity-Status: Confirmed Sep 21 12:34:13.993217 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Is-Admin-Project: True Sep 21 12:34:13.993217 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Id: default Sep 21 12:34:13.993217 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Name: Default Sep 21 12:34:13.993217 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Id: 95515a2858124583ac138aa6350e4bc3 Sep 21 12:34:13.993217 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Name: tempest-TestShelveInstance-2143060141 Sep 21 12:34:13.993217 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Role: reader,member Sep 21 12:34:13.993217 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Roles: reader,member Sep 21 12:34:13.994799 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/95515a2858124583ac138aa6350e4bc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/95515a2858124583ac138aa6350e4bc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_95515a2858124583ac138aa6350e4bc3", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/95515a2858124583ac138aa6350e4bc3"}]}] Sep 21 12:34:13.994799 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant: tempest-TestShelveInstance-2143060141 Sep 21 12:34:13.994799 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Id: 95515a2858124583ac138aa6350e4bc3 Sep 21 12:34:13.994799 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Name: tempest-TestShelveInstance-2143060141 Sep 21 12:34:13.994799 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User: tempest-TestShelveInstance-2143060141-project Sep 21 12:34:13.994799 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Id: default Sep 21 12:34:13.994799 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Name: Default Sep 21 12:34:13.994799 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Id: 94c4cdfb0f264398a7d3b155a9523b11 Sep 21 12:34:13.994799 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Name: tempest-TestShelveInstance-2143060141-project Sep 21 12:34:13.994799 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: method: > Sep 21 12:34:13.994799 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: exception: Instance 66e9cb90-c71a-420a-b647-991844d5c17c could not be found. Sep 21 12:34:13.994799 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: action_args: {'id': '66e9cb90-c71a-420a-b647-991844d5c17c'} Sep 21 12:34:13.995684 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:34:13.995684 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:34:13.995684 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:34:13.995684 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:34:13.995684 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:34:13.995684 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:34:13.995684 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:34:13.995684 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:34:13.995684 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:34:13.995684 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:34:13.995684 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66e9cb90-c71a-420a-b647-991844d5c17c could not be found. Sep 21 12:34:13.995684 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:34:13.995684 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:34:13.995684 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:34:13.995684 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:34:13.995684 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:34:13.995684 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:34:13.995684 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:34:13.995684 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:34:13.995684 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:34:13.997270 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:34:13.997270 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 12:34:13.997270 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 12:34:13.997270 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:34:13.997270 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:34:13.997270 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:34:13.997270 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:34:13.997270 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66e9cb90-c71a-420a-b647-991844d5c17c could not be found. Sep 21 12:34:13.997270 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:34:13.997270 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:34:13.997270 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:34:13.997270 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:34:13.997270 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:34:13.997270 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:34:13.997270 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:34:13.997270 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:34:13.997270 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66e9cb90-c71a-420a-b647-991844d5c17c could not be found. Sep 21 12:34:13.997270 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:34:13.998632 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-98960045-bd5e-4d23-92d0-b63e68a264c8 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Returning 404 to user: Instance 66e9cb90-c71a-420a-b647-991844d5c17c could not be found. {{(pid=120462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:34:13.998632 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-98960045-bd5e-4d23-92d0-b63e68a264c8 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c" status: 404 len: 111 microversion: 2.1 time: 0.030916 Sep 21 12:34:13.998632 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 521/1026] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:34:13 2022] GET /compute/v2.1/servers/66e9cb90-c71a-420a-b647-991844d5c17c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:34:14.153677 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-47823f7c-b98c-4cdb-8566-66162452c229 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] Calling method '.version_select at 0x7fe4c9409f70>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:14.178053 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-47823f7c-b98c-4cdb-8566-66162452c229 tempest-TestShelveInstance-2143060141 tempest-TestShelveInstance-2143060141-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-250182085" status: 202 len: 0 microversion: 2.1 time: 0.028603 Sep 21 12:34:14.179446 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 506/1027] 10.222.0.71 () {58 vars in 1251 bytes} [Wed Sep 21 12:34:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-250182085 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 21 12:34:33.793968 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-db1b1c4b-4aa5-46d9-b782-e5655b5d12b6 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:33.794474 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-db1b1c4b-4aa5-46d9-b782-e5655b5d12b6 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 136bd64b-32e2-4d7c-b864-99becaf61714] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:34:33.797086 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_api:SELECT=8 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:34:33.797736 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=16 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:34:33.803568 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-db1b1c4b-4aa5-46d9-b782-e5655b5d12b6 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:33.804084 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-db1b1c4b-4aa5-46d9-b782-e5655b5d12b6 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:33.804525 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-db1b1c4b-4aa5-46d9-b782-e5655b5d12b6 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:33.805221 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-db1b1c4b-4aa5-46d9-b782-e5655b5d12b6 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:33.805679 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-db1b1c4b-4aa5-46d9-b782-e5655b5d12b6 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:33.806108 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-db1b1c4b-4aa5-46d9-b782-e5655b5d12b6 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:33.830330 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-db1b1c4b-4aa5-46d9-b782-e5655b5d12b6 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714/ips" status: 200 len: 148 microversion: 2.1 time: 0.040155 Sep 21 12:34:33.830908 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 522/1028] 10.222.0.71 () {58 vars in 1248 bytes} [Wed Sep 21 12:34:33 2022] GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714/ips => generated 148 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:34:33.844085 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-8f0c65c6-e4ab-4212-bd85-54628dbff618 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15a3aec3-c68d-479e-badf-340f53061128"}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:34:33.846439 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-8f0c65c6-e4ab-4212-bd85-54628dbff618 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 136bd64b-32e2-4d7c-b864-99becaf61714] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:34:33.848653 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:34:33.849293 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:34:33.856653 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8f0c65c6-e4ab-4212-bd85-54628dbff618 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:33.857145 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8f0c65c6-e4ab-4212-bd85-54628dbff618 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:33.857588 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8f0c65c6-e4ab-4212-bd85-54628dbff618 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:33.858289 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8f0c65c6-e4ab-4212-bd85-54628dbff618 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:33.858752 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8f0c65c6-e4ab-4212-bd85-54628dbff618 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:33.859186 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8f0c65c6-e4ab-4212-bd85-54628dbff618 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:33.943033 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.wsgi [None req-8f0c65c6-e4ab-4212-bd85-54628dbff618 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] HTTP exception thrown: Invalid volume: volume 15a3aec3-c68d-479e-badf-340f53061128 is already attached to instances: e17630cc-94bc-4b00-a64e-3c092f04cb1a Sep 21 12:34:33.944832 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-8f0c65c6-e4ab-4212-bd85-54628dbff618 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Request method failure captured: Sep 21 12:34:33.944832 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: request: POST /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714/os-volume_attachments HTTP/1.1 Sep 21 12:34:33.944832 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept: application/json Sep 21 12:34:33.944832 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept-Encoding: identity Sep 21 12:34:33.944832 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Connection: close Sep 21 12:34:33.944832 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Length: 74 Sep 21 12:34:33.944832 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Type: application/json Sep 21 12:34:33.944832 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Host: 10.222.0.71 Sep 21 12:34:33.944832 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Openstack-System-Scope: None Sep 21 12:34:33.944832 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: User-Agent: python-urllib3/1.26.12 Sep 21 12:34:33.944832 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Auth-Token: gAAAAABjKwQbqCTIemwdFFQg4iXhIhsYIA26P2YauPIL4u-NnB6IhqS_YvqFD-8J1npMFI_nNFzmN0CnWmYrRfR3q-kNeYlkoz_mojSbL04ZdZGfD7Us18CZ0XAmBUWJA2QleQStXzvqL0eNZfiCAHfkcyv8CGZMSMlFp6BBl5cDKWdeHuqik0o Sep 21 12:34:33.944832 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Id: None Sep 21 12:34:33.944832 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Name: None Sep 21 12:34:33.944832 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Identity-Status: Confirmed Sep 21 12:34:33.944832 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Is-Admin-Project: True Sep 21 12:34:33.944832 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Id: default Sep 21 12:34:33.944832 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Name: Default Sep 21 12:34:33.944832 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Id: bd7f2ef25e054b619068baf878bead18 Sep 21 12:34:33.944832 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Name: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:34:33.944832 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Role: reader,member Sep 21 12:34:33.944832 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Roles: reader,member Sep 21 12:34:33.946428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/bd7f2ef25e054b619068baf878bead18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/bd7f2ef25e054b619068baf878bead18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_bd7f2ef25e054b619068baf878bead18", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/bd7f2ef25e054b619068baf878bead18"}]}] Sep 21 12:34:33.946428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:34:33.946428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Id: bd7f2ef25e054b619068baf878bead18 Sep 21 12:34:33.946428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:34:33.946428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User: tempest-AttachVolumeNegativeTest-367231197-project Sep 21 12:34:33.946428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Id: default Sep 21 12:34:33.946428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Name: Default Sep 21 12:34:33.946428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Id: 90d4dfe489634f3c9346b0ab86408e3b Sep 21 12:34:33.946428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Name: tempest-AttachVolumeNegativeTest-367231197-project Sep 21 12:34:33.946428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Sep 21 12:34:33.946428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: {"volumeAttachment": {"volumeId": "15a3aec3-c68d-479e-badf-340f53061128"}} Sep 21 12:34:33.946428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: method: > Sep 21 12:34:33.947367 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: exception: Invalid volume: volume 15a3aec3-c68d-479e-badf-340f53061128 is already attached to instances: e17630cc-94bc-4b00-a64e-3c092f04cb1a Sep 21 12:34:33.947367 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: action_args: {'server_id': '136bd64b-32e2-4d7c-b864-99becaf61714', 'body': {'volumeAttachment': {'volumeId': '15a3aec3-c68d-479e-badf-340f53061128'}}} Sep 21 12:34:33.947367 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:34:33.947367 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:34:33.947367 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 21 12:34:33.947367 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 21 12:34:33.947367 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 21 12:34:33.947367 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 21 12:34:33.947367 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 21 12:34:33.947367 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 21 12:34:33.947367 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 21 12:34:33.947367 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 21 12:34:33.947367 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 21 12:34:33.947367 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 21 12:34:33.947367 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 15a3aec3-c68d-479e-badf-340f53061128 is already attached to instances: e17630cc-94bc-4b00-a64e-3c092f04cb1a Sep 21 12:34:33.947367 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:34:33.947367 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:34:33.947367 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:34:33.947367 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:34:33.948933 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:34:33.948933 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:34:33.948933 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:34:33.948933 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:34:33.948933 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:34:33.948933 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:34:33.948933 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 21 12:34:33.948933 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 21 12:34:33.948933 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 21 12:34:33.948933 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 21 12:34:33.948933 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 21 12:34:33.948933 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 21 12:34:33.948933 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 21 12:34:33.948933 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 21 12:34:33.948933 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 15a3aec3-c68d-479e-badf-340f53061128 is already attached to instances: e17630cc-94bc-4b00-a64e-3c092f04cb1a Sep 21 12:34:33.948933 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:34:33.948933 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:34:33.948933 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:34:33.948933 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:34:33.948933 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:34:33.950991 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:34:33.950991 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:34:33.950991 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:34:33.950991 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 15a3aec3-c68d-479e-badf-340f53061128 is already attached to instances: e17630cc-94bc-4b00-a64e-3c092f04cb1a Sep 21 12:34:33.950991 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:34:33.950991 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-8f0c65c6-e4ab-4212-bd85-54628dbff618 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Returning 400 to user: Invalid volume: volume 15a3aec3-c68d-479e-badf-340f53061128 is already attached to instances: e17630cc-94bc-4b00-a64e-3c092f04cb1a {{(pid=120463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:34:33.950991 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-8f0c65c6-e4ab-4212-bd85-54628dbff618 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "POST /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107326 Sep 21 12:34:33.950991 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 507/1029] 10.222.0.71 () {60 vars in 1323 bytes} [Wed Sep 21 12:34:33 2022] POST /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 21 12:34:33.956564 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-b52b8362-a9c9-4873-b461-aa8fca45029f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:33.957070 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-b52b8362-a9c9-4873-b461-aa8fca45029f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 136bd64b-32e2-4d7c-b864-99becaf61714] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:34:33.963227 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b52b8362-a9c9-4873-b461-aa8fca45029f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:33.963714 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b52b8362-a9c9-4873-b461-aa8fca45029f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:33.964200 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b52b8362-a9c9-4873-b461-aa8fca45029f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:33.965543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b52b8362-a9c9-4873-b461-aa8fca45029f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:33.966005 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b52b8362-a9c9-4873-b461-aa8fca45029f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:33.966440 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b52b8362-a9c9-4873-b461-aa8fca45029f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:33.991134 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-b52b8362-a9c9-4873-b461-aa8fca45029f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 136bd64b-32e2-4d7c-b864-99becaf61714] Going to try to terminate instance {{(pid=120462) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 12:34:34.066479 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-b52b8362-a9c9-4873-b461-aa8fca45029f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "DELETE /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714" status: 204 len: 0 microversion: 2.1 time: 0.113452 Sep 21 12:34:34.067062 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 523/1030] 10.222.0.71 () {58 vars in 1239 bytes} [Wed Sep 21 12:34:33 2022] DELETE /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 21 12:34:34.076231 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-4630c52c-8063-4d46-8145-82f68a5fa3e9 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:34.076850 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-4630c52c-8063-4d46-8145-82f68a5fa3e9 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 136bd64b-32e2-4d7c-b864-99becaf61714] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:34:34.086081 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4630c52c-8063-4d46-8145-82f68a5fa3e9 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:34.086569 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4630c52c-8063-4d46-8145-82f68a5fa3e9 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:34.087009 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4630c52c-8063-4d46-8145-82f68a5fa3e9 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:34.087704 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4630c52c-8063-4d46-8145-82f68a5fa3e9 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:34.088201 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4630c52c-8063-4d46-8145-82f68a5fa3e9 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:34.088672 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4630c52c-8063-4d46-8145-82f68a5fa3e9 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:34.421040 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-4630c52c-8063-4d46-8145-82f68a5fa3e9 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:34:34.428828 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-4630c52c-8063-4d46-8145-82f68a5fa3e9 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714" status: 200 len: 1681 microversion: 2.1 time: 0.357205 Sep 21 12:34:34.429403 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 508/1031] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:34:34 2022] GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714 => generated 1681 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:34:35.453497 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-b3299133-255a-4944-b0fa-85eafd1e276b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:35.454113 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-b3299133-255a-4944-b0fa-85eafd1e276b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 136bd64b-32e2-4d7c-b864-99becaf61714] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:34:35.461152 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b3299133-255a-4944-b0fa-85eafd1e276b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:35.461636 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b3299133-255a-4944-b0fa-85eafd1e276b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:35.462077 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b3299133-255a-4944-b0fa-85eafd1e276b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:35.462774 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b3299133-255a-4944-b0fa-85eafd1e276b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:35.463264 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b3299133-255a-4944-b0fa-85eafd1e276b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:35.463694 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b3299133-255a-4944-b0fa-85eafd1e276b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:35.602357 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-b3299133-255a-4944-b0fa-85eafd1e276b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:34:35.610356 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-b3299133-255a-4944-b0fa-85eafd1e276b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714" status: 200 len: 1681 microversion: 2.1 time: 0.161787 Sep 21 12:34:35.610932 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 524/1032] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:34:35 2022] GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:34:36.641457 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-c3ee92ad-860f-4289-8c3e-42aca1a7fc86 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:36.642159 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-c3ee92ad-860f-4289-8c3e-42aca1a7fc86 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 136bd64b-32e2-4d7c-b864-99becaf61714] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:34:36.648908 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c3ee92ad-860f-4289-8c3e-42aca1a7fc86 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:36.649406 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c3ee92ad-860f-4289-8c3e-42aca1a7fc86 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:36.649853 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c3ee92ad-860f-4289-8c3e-42aca1a7fc86 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:36.650572 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c3ee92ad-860f-4289-8c3e-42aca1a7fc86 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:36.651039 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c3ee92ad-860f-4289-8c3e-42aca1a7fc86 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:36.652171 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c3ee92ad-860f-4289-8c3e-42aca1a7fc86 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:36.713730 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-c3ee92ad-860f-4289-8c3e-42aca1a7fc86 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:34:36.721573 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-c3ee92ad-860f-4289-8c3e-42aca1a7fc86 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714" status: 200 len: 1613 microversion: 2.1 time: 0.084643 Sep 21 12:34:36.722155 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 509/1033] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:34:36 2022] GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714 => generated 1613 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:34:36.795868 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-5150d21d-5f03-441d-892f-e6382ed73286 req-cfadf3ba-4cef-411c-8d73-bd5a0b140201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "136bd64b-32e2-4d7c-b864-99becaf61714", "name": "network-vif-deleted", "tag": "7ae2d2df-8a27-44be-8c47-a003fdd11c3a"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:34:36.807109 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-5150d21d-5f03-441d-892f-e6382ed73286 req-cfadf3ba-4cef-411c-8d73-bd5a0b140201 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:36.807680 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-5150d21d-5f03-441d-892f-e6382ed73286 req-cfadf3ba-4cef-411c-8d73-bd5a0b140201 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:36.808141 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-5150d21d-5f03-441d-892f-e6382ed73286 req-cfadf3ba-4cef-411c-8d73-bd5a0b140201 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:36.820257 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-5150d21d-5f03-441d-892f-e6382ed73286 req-cfadf3ba-4cef-411c-8d73-bd5a0b140201 service nova] Creating event network-vif-deleted:7ae2d2df-8a27-44be-8c47-a003fdd11c3a for instance 136bd64b-32e2-4d7c-b864-99becaf61714 on hv-cinder-85867 Sep 21 12:34:36.825720 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-5150d21d-5f03-441d-892f-e6382ed73286 req-cfadf3ba-4cef-411c-8d73-bd5a0b140201 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033978 Sep 21 12:34:36.826422 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 525/1034] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:34:37.745437 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-d24e5daa-784a-41c9-a16b-a68b2de0d5dc tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:37.746299 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-d24e5daa-784a-41c9-a16b-a68b2de0d5dc tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 136bd64b-32e2-4d7c-b864-99becaf61714] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:34:37.752983 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d24e5daa-784a-41c9-a16b-a68b2de0d5dc tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:37.753944 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d24e5daa-784a-41c9-a16b-a68b2de0d5dc tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:37.754066 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d24e5daa-784a-41c9-a16b-a68b2de0d5dc tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:37.754674 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d24e5daa-784a-41c9-a16b-a68b2de0d5dc tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:37.755137 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d24e5daa-784a-41c9-a16b-a68b2de0d5dc tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:37.755567 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d24e5daa-784a-41c9-a16b-a68b2de0d5dc tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:37.770989 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.wsgi [None req-d24e5daa-784a-41c9-a16b-a68b2de0d5dc tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] HTTP exception thrown: Instance 136bd64b-32e2-4d7c-b864-99becaf61714 could not be found. Sep 21 12:34:37.772629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-d24e5daa-784a-41c9-a16b-a68b2de0d5dc tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Request method failure captured: Sep 21 12:34:37.772629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: request: GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714 HTTP/1.1 Sep 21 12:34:37.772629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept: application/json Sep 21 12:34:37.772629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept-Encoding: identity Sep 21 12:34:37.772629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Connection: close Sep 21 12:34:37.772629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Length: 0 Sep 21 12:34:37.772629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Type: application/json Sep 21 12:34:37.772629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Host: 10.222.0.71 Sep 21 12:34:37.772629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Openstack-System-Scope: None Sep 21 12:34:37.772629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: User-Agent: python-urllib3/1.26.12 Sep 21 12:34:37.772629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Auth-Token: gAAAAABjKwQbqCTIemwdFFQg4iXhIhsYIA26P2YauPIL4u-NnB6IhqS_YvqFD-8J1npMFI_nNFzmN0CnWmYrRfR3q-kNeYlkoz_mojSbL04ZdZGfD7Us18CZ0XAmBUWJA2QleQStXzvqL0eNZfiCAHfkcyv8CGZMSMlFp6BBl5cDKWdeHuqik0o Sep 21 12:34:37.772629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Id: None Sep 21 12:34:37.772629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Name: None Sep 21 12:34:37.772629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Identity-Status: Confirmed Sep 21 12:34:37.772629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Is-Admin-Project: True Sep 21 12:34:37.772629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Id: default Sep 21 12:34:37.772629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Name: Default Sep 21 12:34:37.772629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Id: bd7f2ef25e054b619068baf878bead18 Sep 21 12:34:37.772629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Name: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:34:37.772629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Role: reader,member Sep 21 12:34:37.772629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Roles: reader,member Sep 21 12:34:37.774361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/bd7f2ef25e054b619068baf878bead18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/bd7f2ef25e054b619068baf878bead18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_bd7f2ef25e054b619068baf878bead18", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/bd7f2ef25e054b619068baf878bead18"}]}] Sep 21 12:34:37.774361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:34:37.774361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Id: bd7f2ef25e054b619068baf878bead18 Sep 21 12:34:37.774361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:34:37.774361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User: tempest-AttachVolumeNegativeTest-367231197-project Sep 21 12:34:37.774361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Id: default Sep 21 12:34:37.774361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Name: Default Sep 21 12:34:37.774361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Id: 90d4dfe489634f3c9346b0ab86408e3b Sep 21 12:34:37.774361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Name: tempest-AttachVolumeNegativeTest-367231197-project Sep 21 12:34:37.774361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: method: > Sep 21 12:34:37.774361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: exception: Instance 136bd64b-32e2-4d7c-b864-99becaf61714 could not be found. Sep 21 12:34:37.774361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: action_args: {'id': '136bd64b-32e2-4d7c-b864-99becaf61714'} Sep 21 12:34:37.775310 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:34:37.775310 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:34:37.775310 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:34:37.775310 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:34:37.775310 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:34:37.775310 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:34:37.775310 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:34:37.775310 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:34:37.775310 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:34:37.775310 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:34:37.775310 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 136bd64b-32e2-4d7c-b864-99becaf61714 could not be found. Sep 21 12:34:37.775310 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:34:37.775310 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:34:37.775310 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:34:37.775310 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:34:37.775310 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:34:37.775310 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:34:37.775310 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:34:37.775310 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:34:37.775310 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:34:37.776753 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:34:37.776753 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 12:34:37.776753 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 12:34:37.776753 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:34:37.776753 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:34:37.776753 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:34:37.776753 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:34:37.776753 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 136bd64b-32e2-4d7c-b864-99becaf61714 could not be found. Sep 21 12:34:37.776753 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:34:37.776753 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:34:37.776753 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:34:37.776753 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:34:37.776753 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:34:37.776753 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:34:37.776753 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:34:37.776753 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:34:37.776753 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 136bd64b-32e2-4d7c-b864-99becaf61714 could not be found. Sep 21 12:34:37.776753 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:34:37.778552 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-d24e5daa-784a-41c9-a16b-a68b2de0d5dc tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Returning 404 to user: Instance 136bd64b-32e2-4d7c-b864-99becaf61714 could not be found. {{(pid=120463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:34:37.778552 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-d24e5daa-784a-41c9-a16b-a68b2de0d5dc tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714" status: 404 len: 111 microversion: 2.1 time: 0.032553 Sep 21 12:34:37.778552 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 510/1035] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:34:37 2022] GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:34:37.784110 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-e6f756c3-0982-4987-8400-0168729ef15d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '.version_select at 0x7fe4cc6ba040>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:37.804345 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-e6f756c3-0982-4987-8400-0168729ef15d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1004733291" status: 202 len: 0 microversion: 2.1 time: 0.024356 Sep 21 12:34:37.808238 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 526/1036] 10.222.0.71 () {58 vars in 1221 bytes} [Wed Sep 21 12:34:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1004733291 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 12:34:38.466748 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-60722ac9-c6b3-405d-8c78-81055d894884 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:38.467251 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-60722ac9-c6b3-405d-8c78-81055d894884 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: e17630cc-94bc-4b00-a64e-3c092f04cb1a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:34:38.473229 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-60722ac9-c6b3-405d-8c78-81055d894884 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:38.473718 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-60722ac9-c6b3-405d-8c78-81055d894884 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:38.474161 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-60722ac9-c6b3-405d-8c78-81055d894884 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:38.474856 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-60722ac9-c6b3-405d-8c78-81055d894884 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:38.475315 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-60722ac9-c6b3-405d-8c78-81055d894884 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:38.475746 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-60722ac9-c6b3-405d-8c78-81055d894884 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:38.556765 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.objects.instance [None req-60722ac9-c6b3-405d-8c78-81055d894884 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lazy-loading 'services' on Instance uuid e17630cc-94bc-4b00-a64e-3c092f04cb1a {{(pid=120463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 12:34:38.639045 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-60722ac9-c6b3-405d-8c78-81055d894884 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "DELETE /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a/os-volume_attachments/15a3aec3-c68d-479e-badf-340f53061128" status: 202 len: 0 microversion: 2.1 time: 0.176186 Sep 21 12:34:38.639827 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 511/1037] 10.222.0.71 () {58 vars in 1416 bytes} [Wed Sep 21 12:34:38 2022] DELETE /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a/os-volume_attachments/15a3aec3-c68d-479e-badf-340f53061128 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 12:34:38.648862 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-d5177c43-c39b-4668-bbc8-2a593ebce264 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:38.651529 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-d5177c43-c39b-4668-bbc8-2a593ebce264 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: e17630cc-94bc-4b00-a64e-3c092f04cb1a] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:34:38.661075 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d5177c43-c39b-4668-bbc8-2a593ebce264 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:38.661075 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d5177c43-c39b-4668-bbc8-2a593ebce264 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:38.661408 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d5177c43-c39b-4668-bbc8-2a593ebce264 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:38.662660 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d5177c43-c39b-4668-bbc8-2a593ebce264 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:38.663333 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d5177c43-c39b-4668-bbc8-2a593ebce264 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:38.663864 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d5177c43-c39b-4668-bbc8-2a593ebce264 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:38.695551 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-d5177c43-c39b-4668-bbc8-2a593ebce264 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051025 Sep 21 12:34:38.696092 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 527/1038] 10.222.0.71 () {58 vars in 1302 bytes} [Wed Sep 21 12:34:38 2022] GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 12:34:39.708856 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-d5e14295-2ab5-4a0d-b9cd-44eaf2407d7a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:39.711187 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-d5e14295-2ab5-4a0d-b9cd-44eaf2407d7a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: e17630cc-94bc-4b00-a64e-3c092f04cb1a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:34:39.717811 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d5e14295-2ab5-4a0d-b9cd-44eaf2407d7a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:39.718294 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d5e14295-2ab5-4a0d-b9cd-44eaf2407d7a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:39.718726 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d5e14295-2ab5-4a0d-b9cd-44eaf2407d7a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:39.719414 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d5e14295-2ab5-4a0d-b9cd-44eaf2407d7a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:39.719901 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d5e14295-2ab5-4a0d-b9cd-44eaf2407d7a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:39.720327 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d5e14295-2ab5-4a0d-b9cd-44eaf2407d7a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:39.750020 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-d5e14295-2ab5-4a0d-b9cd-44eaf2407d7a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046217 Sep 21 12:34:39.750593 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 512/1039] 10.222.0.71 () {58 vars in 1302 bytes} [Wed Sep 21 12:34:39 2022] GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 21 12:34:39.814641 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-25f77877-75cc-44e5-bf80-ce0cd58878e1 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:39.815160 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-25f77877-75cc-44e5-bf80-ce0cd58878e1 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: e17630cc-94bc-4b00-a64e-3c092f04cb1a] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:34:39.821513 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-25f77877-75cc-44e5-bf80-ce0cd58878e1 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:39.821995 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-25f77877-75cc-44e5-bf80-ce0cd58878e1 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:39.822451 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-25f77877-75cc-44e5-bf80-ce0cd58878e1 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:39.823126 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-25f77877-75cc-44e5-bf80-ce0cd58878e1 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:39.823582 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-25f77877-75cc-44e5-bf80-ce0cd58878e1 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:39.824069 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-25f77877-75cc-44e5-bf80-ce0cd58878e1 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:39.849243 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-25f77877-75cc-44e5-bf80-ce0cd58878e1 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: e17630cc-94bc-4b00-a64e-3c092f04cb1a] Going to try to terminate instance {{(pid=120462) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 12:34:39.924550 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-25f77877-75cc-44e5-bf80-ce0cd58878e1 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "DELETE /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a" status: 204 len: 0 microversion: 2.1 time: 0.113411 Sep 21 12:34:39.925344 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 528/1040] 10.222.0.71 () {58 vars in 1239 bytes} [Wed Sep 21 12:34:39 2022] DELETE /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 21 12:34:39.934846 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-e5cc057c-4741-4b3a-a148-dfdeaabdad53 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:39.935479 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-e5cc057c-4741-4b3a-a148-dfdeaabdad53 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: e17630cc-94bc-4b00-a64e-3c092f04cb1a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:34:39.941812 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e5cc057c-4741-4b3a-a148-dfdeaabdad53 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:39.942306 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e5cc057c-4741-4b3a-a148-dfdeaabdad53 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:39.942771 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e5cc057c-4741-4b3a-a148-dfdeaabdad53 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:39.943461 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e5cc057c-4741-4b3a-a148-dfdeaabdad53 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:39.943956 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e5cc057c-4741-4b3a-a148-dfdeaabdad53 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:39.944398 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e5cc057c-4741-4b3a-a148-dfdeaabdad53 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:40.072948 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-e5cc057c-4741-4b3a-a148-dfdeaabdad53 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:34:40.080715 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-e5cc057c-4741-4b3a-a148-dfdeaabdad53 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a" status: 200 len: 1678 microversion: 2.1 time: 0.150839 Sep 21 12:34:40.081292 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 513/1041] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:34:39 2022] GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:34:41.104780 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-d7748769-f804-4e7b-b0c7-6d22818062f8 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:41.105497 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-d7748769-f804-4e7b-b0c7-6d22818062f8 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: e17630cc-94bc-4b00-a64e-3c092f04cb1a] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:34:41.111865 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d7748769-f804-4e7b-b0c7-6d22818062f8 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:41.112399 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d7748769-f804-4e7b-b0c7-6d22818062f8 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:41.112840 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d7748769-f804-4e7b-b0c7-6d22818062f8 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:41.113541 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d7748769-f804-4e7b-b0c7-6d22818062f8 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:41.113997 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d7748769-f804-4e7b-b0c7-6d22818062f8 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:41.114425 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d7748769-f804-4e7b-b0c7-6d22818062f8 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:41.241939 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-d7748769-f804-4e7b-b0c7-6d22818062f8 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:34:41.250282 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-d7748769-f804-4e7b-b0c7-6d22818062f8 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a" status: 200 len: 1678 microversion: 2.1 time: 0.149747 Sep 21 12:34:41.250847 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 529/1042] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:34:41 2022] GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:34:42.273825 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-e6f1689d-6d3a-4b7a-b139-1111d92add97 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:42.274524 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-e6f1689d-6d3a-4b7a-b139-1111d92add97 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: e17630cc-94bc-4b00-a64e-3c092f04cb1a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:34:42.281897 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e6f1689d-6d3a-4b7a-b139-1111d92add97 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:42.282402 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e6f1689d-6d3a-4b7a-b139-1111d92add97 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:42.282845 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e6f1689d-6d3a-4b7a-b139-1111d92add97 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:42.283562 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e6f1689d-6d3a-4b7a-b139-1111d92add97 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:42.284216 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e6f1689d-6d3a-4b7a-b139-1111d92add97 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:42.284650 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e6f1689d-6d3a-4b7a-b139-1111d92add97 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:42.352030 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-e6f1689d-6d3a-4b7a-b139-1111d92add97 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:34:42.360221 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-e6f1689d-6d3a-4b7a-b139-1111d92add97 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a" status: 200 len: 1612 microversion: 2.1 time: 0.090282 Sep 21 12:34:42.360744 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 514/1043] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:34:42 2022] GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a => generated 1612 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:34:42.542123 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-90f8f926-c7ea-4115-a512-1e3ebed74b55 req-d39f91b6-ec9e-4905-8536-ee48e6b6e272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e17630cc-94bc-4b00-a64e-3c092f04cb1a", "name": "network-vif-deleted", "tag": "050f2d58-b5dc-42b1-ac31-96b06caf931b"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:34:42.553554 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-90f8f926-c7ea-4115-a512-1e3ebed74b55 req-d39f91b6-ec9e-4905-8536-ee48e6b6e272 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:42.554028 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-90f8f926-c7ea-4115-a512-1e3ebed74b55 req-d39f91b6-ec9e-4905-8536-ee48e6b6e272 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:42.554403 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-90f8f926-c7ea-4115-a512-1e3ebed74b55 req-d39f91b6-ec9e-4905-8536-ee48e6b6e272 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:42.569871 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-90f8f926-c7ea-4115-a512-1e3ebed74b55 req-d39f91b6-ec9e-4905-8536-ee48e6b6e272 service nova] Creating event network-vif-deleted:050f2d58-b5dc-42b1-ac31-96b06caf931b for instance e17630cc-94bc-4b00-a64e-3c092f04cb1a on hv-cinder-85867 Sep 21 12:34:42.576632 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-90f8f926-c7ea-4115-a512-1e3ebed74b55 req-d39f91b6-ec9e-4905-8536-ee48e6b6e272 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038377 Sep 21 12:34:42.577614 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 530/1044] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:34:43.383518 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-cb3cf410-4411-4b5b-ba90-20d3b1210b02 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:43.384172 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-cb3cf410-4411-4b5b-ba90-20d3b1210b02 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: e17630cc-94bc-4b00-a64e-3c092f04cb1a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:34:43.390879 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cb3cf410-4411-4b5b-ba90-20d3b1210b02 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:43.391373 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cb3cf410-4411-4b5b-ba90-20d3b1210b02 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:43.391835 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cb3cf410-4411-4b5b-ba90-20d3b1210b02 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:43.392578 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cb3cf410-4411-4b5b-ba90-20d3b1210b02 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:43.393034 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cb3cf410-4411-4b5b-ba90-20d3b1210b02 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:43.393462 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cb3cf410-4411-4b5b-ba90-20d3b1210b02 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:43.409878 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.wsgi [None req-cb3cf410-4411-4b5b-ba90-20d3b1210b02 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] HTTP exception thrown: Instance e17630cc-94bc-4b00-a64e-3c092f04cb1a could not be found. Sep 21 12:34:43.411563 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-cb3cf410-4411-4b5b-ba90-20d3b1210b02 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Request method failure captured: Sep 21 12:34:43.411563 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: request: GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a HTTP/1.1 Sep 21 12:34:43.411563 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept: application/json Sep 21 12:34:43.411563 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept-Encoding: identity Sep 21 12:34:43.411563 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Connection: close Sep 21 12:34:43.411563 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Length: 0 Sep 21 12:34:43.411563 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Type: application/json Sep 21 12:34:43.411563 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Host: 10.222.0.71 Sep 21 12:34:43.411563 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Openstack-System-Scope: None Sep 21 12:34:43.411563 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: User-Agent: python-urllib3/1.26.12 Sep 21 12:34:43.411563 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Auth-Token: gAAAAABjKwQbqCTIemwdFFQg4iXhIhsYIA26P2YauPIL4u-NnB6IhqS_YvqFD-8J1npMFI_nNFzmN0CnWmYrRfR3q-kNeYlkoz_mojSbL04ZdZGfD7Us18CZ0XAmBUWJA2QleQStXzvqL0eNZfiCAHfkcyv8CGZMSMlFp6BBl5cDKWdeHuqik0o Sep 21 12:34:43.411563 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Id: None Sep 21 12:34:43.411563 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Name: None Sep 21 12:34:43.411563 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Identity-Status: Confirmed Sep 21 12:34:43.411563 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Is-Admin-Project: True Sep 21 12:34:43.411563 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Id: default Sep 21 12:34:43.411563 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Name: Default Sep 21 12:34:43.411563 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Id: bd7f2ef25e054b619068baf878bead18 Sep 21 12:34:43.411563 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Name: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:34:43.411563 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Role: reader,member Sep 21 12:34:43.411563 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Roles: reader,member Sep 21 12:34:43.413204 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/bd7f2ef25e054b619068baf878bead18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/bd7f2ef25e054b619068baf878bead18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_bd7f2ef25e054b619068baf878bead18", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/bd7f2ef25e054b619068baf878bead18"}]}] Sep 21 12:34:43.413204 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:34:43.413204 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Id: bd7f2ef25e054b619068baf878bead18 Sep 21 12:34:43.413204 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:34:43.413204 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User: tempest-AttachVolumeNegativeTest-367231197-project Sep 21 12:34:43.413204 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Id: default Sep 21 12:34:43.413204 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Name: Default Sep 21 12:34:43.413204 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Id: 90d4dfe489634f3c9346b0ab86408e3b Sep 21 12:34:43.413204 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Name: tempest-AttachVolumeNegativeTest-367231197-project Sep 21 12:34:43.413204 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: method: > Sep 21 12:34:43.413204 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: exception: Instance e17630cc-94bc-4b00-a64e-3c092f04cb1a could not be found. Sep 21 12:34:43.413204 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: action_args: {'id': 'e17630cc-94bc-4b00-a64e-3c092f04cb1a'} Sep 21 12:34:43.414554 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:34:43.414554 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:34:43.414554 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:34:43.414554 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:34:43.414554 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:34:43.414554 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:34:43.414554 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:34:43.414554 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:34:43.414554 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:34:43.414554 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:34:43.414554 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e17630cc-94bc-4b00-a64e-3c092f04cb1a could not be found. Sep 21 12:34:43.414554 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:34:43.414554 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:34:43.414554 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:34:43.414554 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:34:43.414554 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:34:43.414554 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:34:43.414554 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:34:43.414554 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:34:43.414554 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:34:43.416144 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:34:43.416144 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 12:34:43.416144 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 12:34:43.416144 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:34:43.416144 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:34:43.416144 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:34:43.416144 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:34:43.416144 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e17630cc-94bc-4b00-a64e-3c092f04cb1a could not be found. Sep 21 12:34:43.416144 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:34:43.416144 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:34:43.416144 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:34:43.416144 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:34:43.416144 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:34:43.416144 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:34:43.416144 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:34:43.416144 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:34:43.416144 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e17630cc-94bc-4b00-a64e-3c092f04cb1a could not be found. Sep 21 12:34:43.416144 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:34:43.417736 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-cb3cf410-4411-4b5b-ba90-20d3b1210b02 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Returning 404 to user: Instance e17630cc-94bc-4b00-a64e-3c092f04cb1a could not be found. {{(pid=120463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:34:43.417736 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-cb3cf410-4411-4b5b-ba90-20d3b1210b02 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a" status: 404 len: 111 microversion: 2.1 time: 0.033537 Sep 21 12:34:43.417736 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 515/1045] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:34:43 2022] GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:34:43.423231 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-13bce907-df6e-49dd-8b45-08da7d5b55cc tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '.version_select at 0x7fe4cc61cb80>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:43.442836 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-13bce907-df6e-49dd-8b45-08da7d5b55cc tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-476170528" status: 202 len: 0 microversion: 2.1 time: 0.023749 Sep 21 12:34:43.443392 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 531/1046] 10.222.0.71 () {58 vars in 1218 bytes} [Wed Sep 21 12:34:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-476170528 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 12:34:44.048856 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-df924041-dd25-4329-ace7-3ab23635916e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Action: 'create', calling method: .version_select at 0x7fe4c92eb4c0>, body: {"keypair": {"name": "tempest-keypair-753366204", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALIhHlXM/S/z2tsyKUpCkHzMjKE5gTICfcvNsrxROAO60R1P2c6ZkqUikHwiInX3tV+n6h/Ul2HrsXuUe+xySrdJgvRepp5fkgoB/fPzkWZxGwmoL4wWJx/Nav4WD0vMg=="}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:34:44.064795 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.quota [None req-df924041-dd25-4329-ace7-3ab23635916e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Getting quotas for project bd7f2ef25e054b619068baf878bead18. Resources: {'key_pairs'} {{(pid=120463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 12:34:44.068641 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.quota [None req-df924041-dd25-4329-ace7-3ab23635916e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Getting quotas for user 90d4dfe489634f3c9346b0ab86408e3b and project bd7f2ef25e054b619068baf878bead18. Resources: {'key_pairs'} {{(pid=120463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 12:34:44.090866 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-df924041-dd25-4329-ace7-3ab23635916e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046004 Sep 21 12:34:44.091463 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 516/1047] 10.222.0.71 () {60 vars in 1159 bytes} [Wed Sep 21 12:34:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:34:45.345757 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-f7f3ffc5-98ef-4821-aba0-0b0cfc742830 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1124099889", "imageRef": "1e3a8d95-6338-499c-af91-e3d1345af950", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8f74bce-cdd1-4f64-9fe4-35f38581a3e4"}], "security_groups": [{"name": "tempest-securitygroup--197591472"}], "key_name": "tempest-keypair-753366204", "user_data": "}} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:34:45.450810 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.network.neutron [None req-f7f3ffc5-98ef-4821-aba0-0b0cfc742830 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] validate_networks() for [('e8f74bce-cdd1-4f64-9fe4-35f38581a3e4', None, None, None, None, None)] {{(pid=120462) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 12:34:45.818261 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-f7f3ffc5-98ef-4821-aba0-0b0cfc742830 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Flavor limits 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 12:34:45.818689 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-f7f3ffc5-98ef-4821-aba0-0b0cfc742830 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Image limits 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 12:34:45.819171 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-f7f3ffc5-98ef-4821-aba0-0b0cfc742830 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Flavor pref 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 12:34:45.819589 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-f7f3ffc5-98ef-4821-aba0-0b0cfc742830 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Image pref 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 12:34:45.820028 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-f7f3ffc5-98ef-4821-aba0-0b0cfc742830 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 12:34:45.829037 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f7f3ffc5-98ef-4821-aba0-0b0cfc742830 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:45.829529 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f7f3ffc5-98ef-4821-aba0-0b0cfc742830 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:45.829968 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f7f3ffc5-98ef-4821-aba0-0b0cfc742830 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:45.830703 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f7f3ffc5-98ef-4821-aba0-0b0cfc742830 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:45.831165 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f7f3ffc5-98ef-4821-aba0-0b0cfc742830 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:45.831596 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f7f3ffc5-98ef-4821-aba0-0b0cfc742830 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:45.848455 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-f7f3ffc5-98ef-4821-aba0-0b0cfc742830 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Getting quotas for project bd7f2ef25e054b619068baf878bead18. Resources: {'instances', 'ram', 'cores'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 12:34:45.852499 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-f7f3ffc5-98ef-4821-aba0-0b0cfc742830 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Getting quotas for user 90d4dfe489634f3c9346b0ab86408e3b and project bd7f2ef25e054b619068baf878bead18. Resources: {'instances', 'ram', 'cores'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 12:34:45.864092 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-f7f3ffc5-98ef-4821-aba0-0b0cfc742830 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Going to run 1 instances... {{(pid=120462) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 12:34:45.866526 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-f7f3ffc5-98ef-4821-aba0-0b0cfc742830 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: a8212565-d87b-4a5a-9618-5f3ad4c9c511] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e3a8d95-6338-499c-af91-e3d1345af950',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 12:34:45.922041 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-f7f3ffc5-98ef-4821-aba0-0b0cfc742830 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.580842 Sep 21 12:34:45.928511 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 532/1048] 10.222.0.71 () {60 vars in 1147 bytes} [Wed Sep 21 12:34:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 21 12:34:45.935261 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-be9a0f5b-61f7-4b8f-8ea0-52861c156a56 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:45.935947 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-be9a0f5b-61f7-4b8f-8ea0-52861c156a56 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: a8212565-d87b-4a5a-9618-5f3ad4c9c511] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:34:45.989316 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-be9a0f5b-61f7-4b8f-8ea0-52861c156a56 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:34:45.997842 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-be9a0f5b-61f7-4b8f-8ea0-52861c156a56 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511" status: 200 len: 1241 microversion: 2.1 time: 0.067078 Sep 21 12:34:45.998416 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 517/1049] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:34:45 2022] GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:34:47.022569 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-80989e21-f047-4aeb-a9f6-388880dd2be8 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:47.023850 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-80989e21-f047-4aeb-a9f6-388880dd2be8 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: a8212565-d87b-4a5a-9618-5f3ad4c9c511] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:34:47.030652 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-80989e21-f047-4aeb-a9f6-388880dd2be8 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:47.031158 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-80989e21-f047-4aeb-a9f6-388880dd2be8 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:47.031628 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-80989e21-f047-4aeb-a9f6-388880dd2be8 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:47.032665 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-80989e21-f047-4aeb-a9f6-388880dd2be8 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:47.033129 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-80989e21-f047-4aeb-a9f6-388880dd2be8 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:47.033558 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-80989e21-f047-4aeb-a9f6-388880dd2be8 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:47.106751 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-80989e21-f047-4aeb-a9f6-388880dd2be8 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:34:47.116912 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-80989e21-f047-4aeb-a9f6-388880dd2be8 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511" status: 200 len: 1301 microversion: 2.1 time: 0.099353 Sep 21 12:34:47.117514 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 533/1050] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:34:47 2022] GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511 => generated 1301 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:34:48.141590 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-dc8d3aef-d188-4df5-b81a-de343838fdd9 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:48.142216 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-dc8d3aef-d188-4df5-b81a-de343838fdd9 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: a8212565-d87b-4a5a-9618-5f3ad4c9c511] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:34:48.149517 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dc8d3aef-d188-4df5-b81a-de343838fdd9 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:48.149998 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dc8d3aef-d188-4df5-b81a-de343838fdd9 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:48.150442 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dc8d3aef-d188-4df5-b81a-de343838fdd9 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:48.151157 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dc8d3aef-d188-4df5-b81a-de343838fdd9 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:48.151627 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dc8d3aef-d188-4df5-b81a-de343838fdd9 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:48.152134 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dc8d3aef-d188-4df5-b81a-de343838fdd9 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:48.291948 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-dc8d3aef-d188-4df5-b81a-de343838fdd9 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:34:48.300193 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-dc8d3aef-d188-4df5-b81a-de343838fdd9 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511" status: 200 len: 1366 microversion: 2.1 time: 0.162454 Sep 21 12:34:48.300862 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 518/1051] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:34:48 2022] GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:34:48.527096 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-cf139b59-bc16-4ed5-8f7d-6856681fb42f req-a43a9f15-fba2-4b2b-b098-58bf5e2d9465 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8212565-d87b-4a5a-9618-5f3ad4c9c511", "tag": "799ca1ff-f8e5-41fd-88f7-cb9c9a83b5ed"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:34:48.554476 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-cf139b59-bc16-4ed5-8f7d-6856681fb42f req-a43a9f15-fba2-4b2b-b098-58bf5e2d9465 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:48.555816 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-cf139b59-bc16-4ed5-8f7d-6856681fb42f req-a43a9f15-fba2-4b2b-b098-58bf5e2d9465 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:48.557267 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-cf139b59-bc16-4ed5-8f7d-6856681fb42f req-a43a9f15-fba2-4b2b-b098-58bf5e2d9465 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:48.574675 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-cf139b59-bc16-4ed5-8f7d-6856681fb42f req-a43a9f15-fba2-4b2b-b098-58bf5e2d9465 service nova] Creating event network-changed:799ca1ff-f8e5-41fd-88f7-cb9c9a83b5ed for instance a8212565-d87b-4a5a-9618-5f3ad4c9c511 on hv-cinder-85867 Sep 21 12:34:48.582095 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-cf139b59-bc16-4ed5-8f7d-6856681fb42f req-a43a9f15-fba2-4b2b-b098-58bf5e2d9465 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058794 Sep 21 12:34:48.583526 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 534/1052] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:34:49.323023 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-60637bda-bfbd-4053-9f55-21c03c6fd692 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:49.323653 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-60637bda-bfbd-4053-9f55-21c03c6fd692 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: a8212565-d87b-4a5a-9618-5f3ad4c9c511] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:34:49.330092 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-60637bda-bfbd-4053-9f55-21c03c6fd692 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:49.330583 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-60637bda-bfbd-4053-9f55-21c03c6fd692 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:49.331026 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-60637bda-bfbd-4053-9f55-21c03c6fd692 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:49.331725 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-60637bda-bfbd-4053-9f55-21c03c6fd692 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:49.332246 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-60637bda-bfbd-4053-9f55-21c03c6fd692 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:49.332688 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-60637bda-bfbd-4053-9f55-21c03c6fd692 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:49.459953 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-60637bda-bfbd-4053-9f55-21c03c6fd692 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:34:49.468408 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-60637bda-bfbd-4053-9f55-21c03c6fd692 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511" status: 200 len: 1366 microversion: 2.1 time: 0.149287 Sep 21 12:34:49.469002 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 519/1053] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:34:49 2022] GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:34:50.491526 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-ff349e91-8037-4a3b-9caf-c03334abb3e6 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:50.492255 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-ff349e91-8037-4a3b-9caf-c03334abb3e6 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: a8212565-d87b-4a5a-9618-5f3ad4c9c511] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:34:50.499037 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ff349e91-8037-4a3b-9caf-c03334abb3e6 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:50.499520 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ff349e91-8037-4a3b-9caf-c03334abb3e6 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:50.499996 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ff349e91-8037-4a3b-9caf-c03334abb3e6 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:50.500691 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ff349e91-8037-4a3b-9caf-c03334abb3e6 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:50.501145 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ff349e91-8037-4a3b-9caf-c03334abb3e6 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:50.501574 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ff349e91-8037-4a3b-9caf-c03334abb3e6 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:50.628354 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-ff349e91-8037-4a3b-9caf-c03334abb3e6 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:34:50.635993 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-ff349e91-8037-4a3b-9caf-c03334abb3e6 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511" status: 200 len: 1366 microversion: 2.1 time: 0.149222 Sep 21 12:34:50.636562 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 535/1054] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:34:50 2022] GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:34:51.668623 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-eeb16bfa-ed99-45dd-8bb0-6eafc70cdf79 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:51.669276 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-eeb16bfa-ed99-45dd-8bb0-6eafc70cdf79 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: a8212565-d87b-4a5a-9618-5f3ad4c9c511] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:34:51.675725 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eeb16bfa-ed99-45dd-8bb0-6eafc70cdf79 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:51.676241 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eeb16bfa-ed99-45dd-8bb0-6eafc70cdf79 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:51.676686 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eeb16bfa-ed99-45dd-8bb0-6eafc70cdf79 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:51.677384 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eeb16bfa-ed99-45dd-8bb0-6eafc70cdf79 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:51.677859 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eeb16bfa-ed99-45dd-8bb0-6eafc70cdf79 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:51.678278 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eeb16bfa-ed99-45dd-8bb0-6eafc70cdf79 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:51.809075 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-eeb16bfa-ed99-45dd-8bb0-6eafc70cdf79 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:34:51.816970 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-eeb16bfa-ed99-45dd-8bb0-6eafc70cdf79 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511" status: 200 len: 1366 microversion: 2.1 time: 0.152226 Sep 21 12:34:51.817539 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 520/1055] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:34:51 2022] GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:34:52.839903 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-05818e0d-2db2-4363-8522-f1e8fec89c2e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:52.840519 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-05818e0d-2db2-4363-8522-f1e8fec89c2e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: a8212565-d87b-4a5a-9618-5f3ad4c9c511] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:34:52.847100 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-05818e0d-2db2-4363-8522-f1e8fec89c2e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:52.847589 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-05818e0d-2db2-4363-8522-f1e8fec89c2e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:52.848074 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-05818e0d-2db2-4363-8522-f1e8fec89c2e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:52.848778 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-05818e0d-2db2-4363-8522-f1e8fec89c2e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:52.849236 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-05818e0d-2db2-4363-8522-f1e8fec89c2e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:52.849666 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-05818e0d-2db2-4363-8522-f1e8fec89c2e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:52.983782 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-05818e0d-2db2-4363-8522-f1e8fec89c2e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:34:52.991379 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-05818e0d-2db2-4363-8522-f1e8fec89c2e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511" status: 200 len: 1366 microversion: 2.1 time: 0.155481 Sep 21 12:34:52.991960 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 536/1056] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:34:52 2022] GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:34:54.014327 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-86798374-857e-4d8b-b104-8bc6982840da tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:54.014943 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-86798374-857e-4d8b-b104-8bc6982840da tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: a8212565-d87b-4a5a-9618-5f3ad4c9c511] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:34:54.022551 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-86798374-857e-4d8b-b104-8bc6982840da tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:54.023036 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-86798374-857e-4d8b-b104-8bc6982840da tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:54.023477 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-86798374-857e-4d8b-b104-8bc6982840da tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:54.024859 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-86798374-857e-4d8b-b104-8bc6982840da tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:54.025326 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-86798374-857e-4d8b-b104-8bc6982840da tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:54.025755 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-86798374-857e-4d8b-b104-8bc6982840da tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:54.162047 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-86798374-857e-4d8b-b104-8bc6982840da tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:34:54.170806 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-86798374-857e-4d8b-b104-8bc6982840da tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511" status: 200 len: 1366 microversion: 2.1 time: 0.160801 Sep 21 12:34:54.171502 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 521/1057] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:34:54 2022] GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:34:54.866932 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-8b852d47-64df-4f7a-bd35-e8db5438ba4a req-057731dd-0e60-4d05-b8e5-d400721b028f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8212565-d87b-4a5a-9618-5f3ad4c9c511", "name": "network-vif-plugged", "status": "completed", "tag": "799ca1ff-f8e5-41fd-88f7-cb9c9a83b5ed"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:34:54.877863 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-8b852d47-64df-4f7a-bd35-e8db5438ba4a req-057731dd-0e60-4d05-b8e5-d400721b028f service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:54.878374 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-8b852d47-64df-4f7a-bd35-e8db5438ba4a req-057731dd-0e60-4d05-b8e5-d400721b028f service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:54.878835 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-8b852d47-64df-4f7a-bd35-e8db5438ba4a req-057731dd-0e60-4d05-b8e5-d400721b028f service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:54.890396 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-8b852d47-64df-4f7a-bd35-e8db5438ba4a req-057731dd-0e60-4d05-b8e5-d400721b028f service nova] Creating event network-vif-plugged:799ca1ff-f8e5-41fd-88f7-cb9c9a83b5ed for instance a8212565-d87b-4a5a-9618-5f3ad4c9c511 on hv-cinder-85867 Sep 21 12:34:54.895362 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-8b852d47-64df-4f7a-bd35-e8db5438ba4a req-057731dd-0e60-4d05-b8e5-d400721b028f service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032189 Sep 21 12:34:54.896001 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 537/1058] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:34:55.193683 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-15426d33-eb31-4bb4-93e8-c1568919c1ed tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:55.194310 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-15426d33-eb31-4bb4-93e8-c1568919c1ed tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: a8212565-d87b-4a5a-9618-5f3ad4c9c511] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:34:55.200836 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-15426d33-eb31-4bb4-93e8-c1568919c1ed tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:55.201330 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-15426d33-eb31-4bb4-93e8-c1568919c1ed tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:55.201775 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-15426d33-eb31-4bb4-93e8-c1568919c1ed tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:55.202487 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-15426d33-eb31-4bb4-93e8-c1568919c1ed tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:55.202935 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-15426d33-eb31-4bb4-93e8-c1568919c1ed tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:55.203370 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-15426d33-eb31-4bb4-93e8-c1568919c1ed tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:55.330972 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-15426d33-eb31-4bb4-93e8-c1568919c1ed tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:34:55.339315 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-15426d33-eb31-4bb4-93e8-c1568919c1ed tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511" status: 200 len: 1366 microversion: 2.1 time: 0.149597 Sep 21 12:34:55.340427 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 522/1059] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:34:55 2022] GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:34:56.360052 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell0:SELECT=2 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:34:56.360843 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell0:SELECT=6 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:34:56.365600 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-465a6cd2-4282-4a05-9627-c33416dfcd93 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:56.366321 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-465a6cd2-4282-4a05-9627-c33416dfcd93 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: a8212565-d87b-4a5a-9618-5f3ad4c9c511] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:34:56.373398 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-465a6cd2-4282-4a05-9627-c33416dfcd93 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:56.373874 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-465a6cd2-4282-4a05-9627-c33416dfcd93 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:56.374313 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-465a6cd2-4282-4a05-9627-c33416dfcd93 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:56.374999 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-465a6cd2-4282-4a05-9627-c33416dfcd93 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:56.375450 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-465a6cd2-4282-4a05-9627-c33416dfcd93 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:56.375891 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-465a6cd2-4282-4a05-9627-c33416dfcd93 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:56.518499 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-465a6cd2-4282-4a05-9627-c33416dfcd93 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:34:56.526242 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-465a6cd2-4282-4a05-9627-c33416dfcd93 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511" status: 200 len: 1366 microversion: 2.1 time: 0.167166 Sep 21 12:34:56.526817 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 538/1060] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:34:56 2022] GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:34:57.550263 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-f0f9fa94-8d38-4264-b76b-389fdf715af3 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:57.550813 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-f0f9fa94-8d38-4264-b76b-389fdf715af3 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: a8212565-d87b-4a5a-9618-5f3ad4c9c511] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:34:57.552768 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell0:SELECT=6 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:34:57.558340 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f0f9fa94-8d38-4264-b76b-389fdf715af3 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:57.558821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f0f9fa94-8d38-4264-b76b-389fdf715af3 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:57.559263 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f0f9fa94-8d38-4264-b76b-389fdf715af3 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:57.559986 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f0f9fa94-8d38-4264-b76b-389fdf715af3 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:57.560440 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f0f9fa94-8d38-4264-b76b-389fdf715af3 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:57.560861 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f0f9fa94-8d38-4264-b76b-389fdf715af3 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:57.694369 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-f0f9fa94-8d38-4264-b76b-389fdf715af3 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:34:57.702946 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-f0f9fa94-8d38-4264-b76b-389fdf715af3 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511" status: 200 len: 1555 microversion: 2.1 time: 0.156634 Sep 21 12:34:57.703532 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 523/1061] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:34:57 2022] GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:34:57.726057 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-583af18a-44dd-4904-8dd3-95043bd45b0a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:34:57.726588 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-583af18a-44dd-4904-8dd3-95043bd45b0a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: a8212565-d87b-4a5a-9618-5f3ad4c9c511] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:34:57.733004 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-583af18a-44dd-4904-8dd3-95043bd45b0a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:57.733485 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-583af18a-44dd-4904-8dd3-95043bd45b0a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:57.733924 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-583af18a-44dd-4904-8dd3-95043bd45b0a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:57.734680 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-583af18a-44dd-4904-8dd3-95043bd45b0a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:57.735107 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-583af18a-44dd-4904-8dd3-95043bd45b0a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:57.735533 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-583af18a-44dd-4904-8dd3-95043bd45b0a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:57.812303 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-583af18a-44dd-4904-8dd3-95043bd45b0a tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090038 Sep 21 12:34:57.812904 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 539/1062] 10.222.0.71 () {58 vars in 1275 bytes} [Wed Sep 21 12:34:57 2022] GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:34:58.755052 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-4560f35b-ca9d-4f35-b565-514fc618460b req-6bef94e2-2eaf-4ff4-ace2-1fb98c3e40c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8212565-d87b-4a5a-9618-5f3ad4c9c511", "tag": "799ca1ff-f8e5-41fd-88f7-cb9c9a83b5ed"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:34:58.765441 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-4560f35b-ca9d-4f35-b565-514fc618460b req-6bef94e2-2eaf-4ff4-ace2-1fb98c3e40c2 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:34:58.765955 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-4560f35b-ca9d-4f35-b565-514fc618460b req-6bef94e2-2eaf-4ff4-ace2-1fb98c3e40c2 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:34:58.766390 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-4560f35b-ca9d-4f35-b565-514fc618460b req-6bef94e2-2eaf-4ff4-ace2-1fb98c3e40c2 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:34:58.777643 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-4560f35b-ca9d-4f35-b565-514fc618460b req-6bef94e2-2eaf-4ff4-ace2-1fb98c3e40c2 service nova] Creating event network-changed:799ca1ff-f8e5-41fd-88f7-cb9c9a83b5ed for instance a8212565-d87b-4a5a-9618-5f3ad4c9c511 on hv-cinder-85867 Sep 21 12:34:58.782879 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-4560f35b-ca9d-4f35-b565-514fc618460b req-6bef94e2-2eaf-4ff4-ace2-1fb98c3e40c2 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031479 Sep 21 12:34:58.783488 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 524/1063] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:35:02.571523 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-22fd4137-085a-40b3-a02d-dca2931e1422 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:35:02.572127 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-22fd4137-085a-40b3-a02d-dca2931e1422 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:35:02.578695 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-22fd4137-085a-40b3-a02d-dca2931e1422 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:02.579178 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-22fd4137-085a-40b3-a02d-dca2931e1422 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:02.579616 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-22fd4137-085a-40b3-a02d-dca2931e1422 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:02.580366 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-22fd4137-085a-40b3-a02d-dca2931e1422 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:02.580823 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-22fd4137-085a-40b3-a02d-dca2931e1422 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:02.581270 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-22fd4137-085a-40b3-a02d-dca2931e1422 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:02.608066 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-22fd4137-085a-40b3-a02d-dca2931e1422 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23] Going to try to terminate instance {{(pid=120462) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 12:35:02.622878 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:35:02.682377 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-22fd4137-085a-40b3-a02d-dca2931e1422 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "DELETE /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23" status: 204 len: 0 microversion: 2.1 time: 0.114907 Sep 21 12:35:02.682987 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 540/1064] 10.222.0.71 () {58 vars in 1239 bytes} [Wed Sep 21 12:35:02 2022] DELETE /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 21 12:35:02.693566 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-2cb1a505-d40e-4896-9cb2-a3a4f8b55ba7 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:35:02.695182 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-2cb1a505-d40e-4896-9cb2-a3a4f8b55ba7 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:35:02.702762 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2cb1a505-d40e-4896-9cb2-a3a4f8b55ba7 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:02.703251 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2cb1a505-d40e-4896-9cb2-a3a4f8b55ba7 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:02.703705 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2cb1a505-d40e-4896-9cb2-a3a4f8b55ba7 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:02.704449 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2cb1a505-d40e-4896-9cb2-a3a4f8b55ba7 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:02.705189 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2cb1a505-d40e-4896-9cb2-a3a4f8b55ba7 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:02.705628 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2cb1a505-d40e-4896-9cb2-a3a4f8b55ba7 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:02.839001 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-2cb1a505-d40e-4896-9cb2-a3a4f8b55ba7 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:35:02.846705 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-2cb1a505-d40e-4896-9cb2-a3a4f8b55ba7 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23" status: 200 len: 1579 microversion: 2.1 time: 0.158765 Sep 21 12:35:02.847266 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 525/1065] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:35:02 2022] GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 => generated 1579 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:35:03.874316 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-7a0213be-30ca-408c-9bb7-c30b215a873c tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:35:03.875007 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-7a0213be-30ca-408c-9bb7-c30b215a873c tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:35:03.876967 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:35:03.882299 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7a0213be-30ca-408c-9bb7-c30b215a873c tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:03.882787 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7a0213be-30ca-408c-9bb7-c30b215a873c tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:03.883226 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7a0213be-30ca-408c-9bb7-c30b215a873c tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:03.883958 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7a0213be-30ca-408c-9bb7-c30b215a873c tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:03.884422 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7a0213be-30ca-408c-9bb7-c30b215a873c tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:03.884854 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7a0213be-30ca-408c-9bb7-c30b215a873c tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:04.024796 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-7a0213be-30ca-408c-9bb7-c30b215a873c tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:35:04.033486 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-7a0213be-30ca-408c-9bb7-c30b215a873c tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23" status: 200 len: 1579 microversion: 2.1 time: 0.167193 Sep 21 12:35:04.034063 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 541/1066] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:35:03 2022] GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 => generated 1579 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:35:05.061377 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-0f6ae117-48a6-4f00-a430-7c3cb09f4791 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:35:05.062003 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-0f6ae117-48a6-4f00-a430-7c3cb09f4791 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:35:05.064545 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:35:05.069724 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0f6ae117-48a6-4f00-a430-7c3cb09f4791 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:05.070210 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0f6ae117-48a6-4f00-a430-7c3cb09f4791 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:05.070645 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0f6ae117-48a6-4f00-a430-7c3cb09f4791 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:05.071342 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0f6ae117-48a6-4f00-a430-7c3cb09f4791 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:05.071813 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0f6ae117-48a6-4f00-a430-7c3cb09f4791 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:05.072243 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-0f6ae117-48a6-4f00-a430-7c3cb09f4791 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:05.077004 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=1 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:35:05.142132 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-0f6ae117-48a6-4f00-a430-7c3cb09f4791 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:35:05.150776 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-0f6ae117-48a6-4f00-a430-7c3cb09f4791 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23" status: 200 len: 1511 microversion: 2.1 time: 0.093313 Sep 21 12:35:05.151558 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 526/1067] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:35:05 2022] GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 => generated 1511 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:35:05.390002 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-35a6e582-6b20-4199-93b8-bb8849f7d0a0 req-c598461e-9af2-4f71-a1ed-3ff4d3e9a4f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23", "name": "network-vif-deleted", "tag": "30cdd6f9-678f-4f65-b2ab-284e35d1463a"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:35:05.402824 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-35a6e582-6b20-4199-93b8-bb8849f7d0a0 req-c598461e-9af2-4f71-a1ed-3ff4d3e9a4f1 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:05.404106 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-35a6e582-6b20-4199-93b8-bb8849f7d0a0 req-c598461e-9af2-4f71-a1ed-3ff4d3e9a4f1 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:05.404541 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-35a6e582-6b20-4199-93b8-bb8849f7d0a0 req-c598461e-9af2-4f71-a1ed-3ff4d3e9a4f1 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:05.417521 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-35a6e582-6b20-4199-93b8-bb8849f7d0a0 req-c598461e-9af2-4f71-a1ed-3ff4d3e9a4f1 service nova] Creating event network-vif-deleted:30cdd6f9-678f-4f65-b2ab-284e35d1463a for instance 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 on hv-cinder-85867 Sep 21 12:35:05.424507 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-35a6e582-6b20-4199-93b8-bb8849f7d0a0 req-c598461e-9af2-4f71-a1ed-3ff4d3e9a4f1 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038194 Sep 21 12:35:05.425483 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 542/1068] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:35:06.175083 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-8966c6cd-8e41-4f95-a31a-de4793a65e96 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:35:06.175830 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-8966c6cd-8e41-4f95-a31a-de4793a65e96 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:35:06.182918 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8966c6cd-8e41-4f95-a31a-de4793a65e96 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:06.183419 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8966c6cd-8e41-4f95-a31a-de4793a65e96 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:06.183907 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8966c6cd-8e41-4f95-a31a-de4793a65e96 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:06.185488 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8966c6cd-8e41-4f95-a31a-de4793a65e96 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:06.185900 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8966c6cd-8e41-4f95-a31a-de4793a65e96 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:06.186344 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8966c6cd-8e41-4f95-a31a-de4793a65e96 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:06.223618 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8966c6cd-8e41-4f95-a31a-de4793a65e96 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:06.224255 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8966c6cd-8e41-4f95-a31a-de4793a65e96 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:06.224892 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8966c6cd-8e41-4f95-a31a-de4793a65e96 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:06.225348 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.objects.instance [None req-8966c6cd-8e41-4f95-a31a-de4793a65e96 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lazy-loading 'fault' on Instance uuid 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 {{(pid=120463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 12:35:06.276801 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-8966c6cd-8e41-4f95-a31a-de4793a65e96 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:35:06.285140 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-8966c6cd-8e41-4f95-a31a-de4793a65e96 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23" status: 200 len: 1230 microversion: 2.1 time: 0.113966 Sep 21 12:35:06.285739 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 527/1069] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:35:06 2022] GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 => generated 1230 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:35:07.310654 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-d9262a29-8594-479d-9c31-80a5a5f2d134 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:35:07.311346 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-d9262a29-8594-479d-9c31-80a5a5f2d134 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:35:07.318111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d9262a29-8594-479d-9c31-80a5a5f2d134 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:07.318598 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d9262a29-8594-479d-9c31-80a5a5f2d134 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:07.319034 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d9262a29-8594-479d-9c31-80a5a5f2d134 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:07.319718 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d9262a29-8594-479d-9c31-80a5a5f2d134 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:07.320192 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d9262a29-8594-479d-9c31-80a5a5f2d134 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:07.320615 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d9262a29-8594-479d-9c31-80a5a5f2d134 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:07.334445 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.wsgi [None req-d9262a29-8594-479d-9c31-80a5a5f2d134 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] HTTP exception thrown: Instance 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 could not be found. Sep 21 12:35:07.336125 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-d9262a29-8594-479d-9c31-80a5a5f2d134 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Request method failure captured: Sep 21 12:35:07.336125 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: request: GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 HTTP/1.1 Sep 21 12:35:07.336125 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept: application/json Sep 21 12:35:07.336125 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept-Encoding: identity Sep 21 12:35:07.336125 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Connection: close Sep 21 12:35:07.336125 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Length: 0 Sep 21 12:35:07.336125 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Type: application/json Sep 21 12:35:07.336125 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Host: 10.222.0.71 Sep 21 12:35:07.336125 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Openstack-System-Scope: None Sep 21 12:35:07.336125 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: User-Agent: python-urllib3/1.26.12 Sep 21 12:35:07.336125 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Auth-Token: gAAAAABjKwQ7mVtGlU3tOeX92rrZRhvq2VYruvrHGgXJ-x6HB7a5FAf6iiJT4sPgEcr7-SdKQDZJ-LjcQBki56eZetiD6li-IOsCJ5bmivzx04pzpw8yQ2EjLDrRqjcRHcrjWA4JZhUqaTJY2GQAGV-wHaWlNUG8A0I6MiweneJ9Z6SHCfC-vvs Sep 21 12:35:07.336125 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Id: None Sep 21 12:35:07.336125 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Name: None Sep 21 12:35:07.336125 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Identity-Status: Confirmed Sep 21 12:35:07.336125 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Is-Admin-Project: True Sep 21 12:35:07.336125 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Id: default Sep 21 12:35:07.336125 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Name: Default Sep 21 12:35:07.336125 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Id: 04bda0b59d3b4bfabf6f1b84fec0d6a6 Sep 21 12:35:07.336125 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Name: tempest-TestVolumeBootPattern-1488736354 Sep 21 12:35:07.336125 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Role: reader,member Sep 21 12:35:07.336125 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Roles: reader,member Sep 21 12:35:07.337797 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/04bda0b59d3b4bfabf6f1b84fec0d6a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/04bda0b59d3b4bfabf6f1b84fec0d6a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_04bda0b59d3b4bfabf6f1b84fec0d6a6", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/04bda0b59d3b4bfabf6f1b84fec0d6a6"}]}] Sep 21 12:35:07.337797 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant: tempest-TestVolumeBootPattern-1488736354 Sep 21 12:35:07.337797 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Id: 04bda0b59d3b4bfabf6f1b84fec0d6a6 Sep 21 12:35:07.337797 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Name: tempest-TestVolumeBootPattern-1488736354 Sep 21 12:35:07.337797 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User: tempest-TestVolumeBootPattern-1488736354-project Sep 21 12:35:07.337797 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Id: default Sep 21 12:35:07.337797 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Name: Default Sep 21 12:35:07.337797 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Id: f84520fd4b434d99ad0dab1a1dd3b033 Sep 21 12:35:07.337797 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Name: tempest-TestVolumeBootPattern-1488736354-project Sep 21 12:35:07.337797 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: method: > Sep 21 12:35:07.337797 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: exception: Instance 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 could not be found. Sep 21 12:35:07.337797 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: action_args: {'id': '03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23'} Sep 21 12:35:07.338971 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:35:07.338971 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:35:07.338971 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:35:07.338971 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:35:07.338971 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:35:07.338971 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:35:07.338971 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:35:07.338971 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:35:07.338971 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:35:07.338971 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:35:07.338971 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 could not be found. Sep 21 12:35:07.338971 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:35:07.338971 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:35:07.338971 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:35:07.338971 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:35:07.338971 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:35:07.338971 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:35:07.338971 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:35:07.338971 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:35:07.338971 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:35:07.340598 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:35:07.340598 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 12:35:07.340598 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 12:35:07.340598 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:35:07.340598 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:35:07.340598 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:35:07.340598 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:35:07.340598 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 could not be found. Sep 21 12:35:07.340598 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:35:07.340598 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:35:07.340598 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:35:07.340598 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:35:07.340598 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:35:07.340598 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:35:07.340598 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:35:07.340598 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:35:07.340598 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 could not be found. Sep 21 12:35:07.340598 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:35:07.342069 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-d9262a29-8594-479d-9c31-80a5a5f2d134 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Returning 404 to user: Instance 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 could not be found. {{(pid=120462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:35:07.342069 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-d9262a29-8594-479d-9c31-80a5a5f2d134 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23" status: 404 len: 111 microversion: 2.1 time: 0.031606 Sep 21 12:35:07.342069 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 543/1070] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:35:07 2022] GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:35:07.436136 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-c00fa074-0999-4a32-bb60-fb40c96d3bb8 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-526492915", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1277426818", "security_groups": [{"name": "tempest-secgroup-smoke-2134419953"}], "block_device_mapping_v2": [{"uuid": "2a9f1e02-3861-4cb7-8479-fcf1b9894ccf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "df063f4b-39ab-4616-b570-b4e44f12336f"}]}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:35:07.547246 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.network.neutron [None req-c00fa074-0999-4a32-bb60-fb40c96d3bb8 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] validate_networks() for [('df063f4b-39ab-4616-b570-b4e44f12336f', None, None, None, None, None)] {{(pid=120463) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 12:35:08.002016 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-c00fa074-0999-4a32-bb60-fb40c96d3bb8 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Flavor limits 0:0:0 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 12:35:08.002440 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-c00fa074-0999-4a32-bb60-fb40c96d3bb8 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Image limits 0:0:0 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 12:35:08.002911 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-c00fa074-0999-4a32-bb60-fb40c96d3bb8 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Flavor pref 0:0:0 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 12:35:08.003322 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-c00fa074-0999-4a32-bb60-fb40c96d3bb8 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Image pref 0:0:0 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 12:35:08.003731 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-c00fa074-0999-4a32-bb60-fb40c96d3bb8 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 12:35:08.012606 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c00fa074-0999-4a32-bb60-fb40c96d3bb8 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:08.013380 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c00fa074-0999-4a32-bb60-fb40c96d3bb8 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:08.013694 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c00fa074-0999-4a32-bb60-fb40c96d3bb8 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:08.014463 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c00fa074-0999-4a32-bb60-fb40c96d3bb8 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:08.014947 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c00fa074-0999-4a32-bb60-fb40c96d3bb8 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:08.015374 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c00fa074-0999-4a32-bb60-fb40c96d3bb8 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:08.032767 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.quota [None req-c00fa074-0999-4a32-bb60-fb40c96d3bb8 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Getting quotas for project 04bda0b59d3b4bfabf6f1b84fec0d6a6. Resources: {'instances', 'ram', 'cores'} {{(pid=120463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 12:35:08.036689 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.quota [None req-c00fa074-0999-4a32-bb60-fb40c96d3bb8 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Getting quotas for user f84520fd4b434d99ad0dab1a1dd3b033 and project 04bda0b59d3b4bfabf6f1b84fec0d6a6. Resources: {'instances', 'ram', 'cores'} {{(pid=120463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 12:35:08.093057 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-c00fa074-0999-4a32-bb60-fb40c96d3bb8 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Going to run 1 instances... {{(pid=120463) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 12:35:08.095183 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-c00fa074-0999-4a32-bb60-fb40c96d3bb8 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 2fcab7c0-b348-4709-b520-255e93f2c145] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2a9f1e02-3861-4cb7-8479-fcf1b9894ccf',volume_size=None,volume_type=None)] {{(pid=120463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 12:35:08.221303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-c00fa074-0999-4a32-bb60-fb40c96d3bb8 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.789672 Sep 21 12:35:08.222032 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 528/1071] 10.222.0.71 () {60 vars in 1147 bytes} [Wed Sep 21 12:35:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 21 12:35:08.233083 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-f6d52335-e44f-4d95-b2f4-3ce3d43e5fbe tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:35:08.233693 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-f6d52335-e44f-4d95-b2f4-3ce3d43e5fbe tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 2fcab7c0-b348-4709-b520-255e93f2c145] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:35:08.291726 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-f6d52335-e44f-4d95-b2f4-3ce3d43e5fbe tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:35:08.299626 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-f6d52335-e44f-4d95-b2f4-3ce3d43e5fbe tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145" status: 200 len: 1094 microversion: 2.1 time: 0.070387 Sep 21 12:35:08.301937 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 544/1072] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:35:08 2022] GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:35:09.324132 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-d608b02d-9e32-4276-90a2-327633bf83cb tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:35:09.324884 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-d608b02d-9e32-4276-90a2-327633bf83cb tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 2fcab7c0-b348-4709-b520-255e93f2c145] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:35:09.331470 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d608b02d-9e32-4276-90a2-327633bf83cb tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:09.332000 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d608b02d-9e32-4276-90a2-327633bf83cb tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:09.332449 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d608b02d-9e32-4276-90a2-327633bf83cb tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:09.333160 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d608b02d-9e32-4276-90a2-327633bf83cb tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:09.333712 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d608b02d-9e32-4276-90a2-327633bf83cb tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:09.334404 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d608b02d-9e32-4276-90a2-327633bf83cb tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:09.398719 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-d608b02d-9e32-4276-90a2-327633bf83cb tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:35:09.407097 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-d608b02d-9e32-4276-90a2-327633bf83cb tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145" status: 200 len: 1200 microversion: 2.1 time: 0.087533 Sep 21 12:35:09.419956 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 529/1073] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:35:09 2022] GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145 => generated 1200 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:35:10.431508 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-975ed575-ebbf-4ba1-b7f2-6ad4322a3846 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:35:10.432066 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-975ed575-ebbf-4ba1-b7f2-6ad4322a3846 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 2fcab7c0-b348-4709-b520-255e93f2c145] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:35:10.438196 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-975ed575-ebbf-4ba1-b7f2-6ad4322a3846 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:10.438686 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-975ed575-ebbf-4ba1-b7f2-6ad4322a3846 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:10.439126 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-975ed575-ebbf-4ba1-b7f2-6ad4322a3846 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:10.439859 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-975ed575-ebbf-4ba1-b7f2-6ad4322a3846 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:10.440320 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-975ed575-ebbf-4ba1-b7f2-6ad4322a3846 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:10.440758 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-975ed575-ebbf-4ba1-b7f2-6ad4322a3846 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:10.941412 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-975ed575-ebbf-4ba1-b7f2-6ad4322a3846 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:35:10.949509 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-975ed575-ebbf-4ba1-b7f2-6ad4322a3846 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145" status: 200 len: 1266 microversion: 2.1 time: 0.521683 Sep 21 12:35:10.952016 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 545/1074] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:35:10 2022] GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145 => generated 1266 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:35:11.088578 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-1f7bdec1-a309-4ac5-9272-43d743b8812a req-f595dedc-f8b5-4d5e-adf2-e82c0e7ef8cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fcab7c0-b348-4709-b520-255e93f2c145", "tag": "99db1c1d-12a1-4bd0-be9f-bfda671be9cc"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:35:11.099377 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-1f7bdec1-a309-4ac5-9272-43d743b8812a req-f595dedc-f8b5-4d5e-adf2-e82c0e7ef8cb service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:11.099911 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-1f7bdec1-a309-4ac5-9272-43d743b8812a req-f595dedc-f8b5-4d5e-adf2-e82c0e7ef8cb service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:11.100343 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-1f7bdec1-a309-4ac5-9272-43d743b8812a req-f595dedc-f8b5-4d5e-adf2-e82c0e7ef8cb service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:11.115000 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-1f7bdec1-a309-4ac5-9272-43d743b8812a req-f595dedc-f8b5-4d5e-adf2-e82c0e7ef8cb service nova] Creating event network-changed:99db1c1d-12a1-4bd0-be9f-bfda671be9cc for instance 2fcab7c0-b348-4709-b520-255e93f2c145 on hv-cinder-85867 Sep 21 12:35:11.119954 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-1f7bdec1-a309-4ac5-9272-43d743b8812a req-f595dedc-f8b5-4d5e-adf2-e82c0e7ef8cb service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035044 Sep 21 12:35:11.120579 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 530/1075] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:35:11.972913 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-bc5379c5-2705-469a-b7e9-8349ac0c2e47 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:35:11.973521 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-bc5379c5-2705-469a-b7e9-8349ac0c2e47 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 2fcab7c0-b348-4709-b520-255e93f2c145] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:35:11.979983 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bc5379c5-2705-469a-b7e9-8349ac0c2e47 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:11.980468 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bc5379c5-2705-469a-b7e9-8349ac0c2e47 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:11.980908 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bc5379c5-2705-469a-b7e9-8349ac0c2e47 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:11.981632 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bc5379c5-2705-469a-b7e9-8349ac0c2e47 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:11.982088 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bc5379c5-2705-469a-b7e9-8349ac0c2e47 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:11.982517 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bc5379c5-2705-469a-b7e9-8349ac0c2e47 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:12.115315 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-bc5379c5-2705-469a-b7e9-8349ac0c2e47 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:35:12.122982 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-bc5379c5-2705-469a-b7e9-8349ac0c2e47 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145" status: 200 len: 1266 microversion: 2.1 time: 0.154016 Sep 21 12:35:12.123554 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 546/1076] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:35:11 2022] GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:35:13.147209 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-ce05a44d-b1f0-451c-b1df-c6bfd4521f00 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:35:13.147936 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-ce05a44d-b1f0-451c-b1df-c6bfd4521f00 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 2fcab7c0-b348-4709-b520-255e93f2c145] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:35:13.154525 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ce05a44d-b1f0-451c-b1df-c6bfd4521f00 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:13.155013 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ce05a44d-b1f0-451c-b1df-c6bfd4521f00 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:13.155461 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ce05a44d-b1f0-451c-b1df-c6bfd4521f00 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:13.156211 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ce05a44d-b1f0-451c-b1df-c6bfd4521f00 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:13.156667 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ce05a44d-b1f0-451c-b1df-c6bfd4521f00 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:13.157100 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ce05a44d-b1f0-451c-b1df-c6bfd4521f00 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:13.285533 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-ce05a44d-b1f0-451c-b1df-c6bfd4521f00 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:35:13.293227 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-ce05a44d-b1f0-451c-b1df-c6bfd4521f00 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145" status: 200 len: 1266 microversion: 2.1 time: 0.150741 Sep 21 12:35:13.294452 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 531/1077] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:35:13 2022] GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:35:14.316559 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-60037531-fea8-43b1-bb1a-61291a2054c0 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:35:14.317178 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-60037531-fea8-43b1-bb1a-61291a2054c0 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 2fcab7c0-b348-4709-b520-255e93f2c145] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:35:14.323684 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-60037531-fea8-43b1-bb1a-61291a2054c0 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:14.324202 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-60037531-fea8-43b1-bb1a-61291a2054c0 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:14.324640 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-60037531-fea8-43b1-bb1a-61291a2054c0 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:14.325337 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-60037531-fea8-43b1-bb1a-61291a2054c0 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:14.325796 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-60037531-fea8-43b1-bb1a-61291a2054c0 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:14.326227 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-60037531-fea8-43b1-bb1a-61291a2054c0 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:14.457154 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-60037531-fea8-43b1-bb1a-61291a2054c0 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:35:14.465180 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-60037531-fea8-43b1-bb1a-61291a2054c0 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145" status: 200 len: 1266 microversion: 2.1 time: 0.152566 Sep 21 12:35:14.465750 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 547/1078] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:35:14 2022] GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:35:15.487581 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-4e6abb67-3794-486d-8c1b-9ff37684182a tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:35:15.488217 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-4e6abb67-3794-486d-8c1b-9ff37684182a tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 2fcab7c0-b348-4709-b520-255e93f2c145] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:35:15.494941 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4e6abb67-3794-486d-8c1b-9ff37684182a tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:15.495439 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4e6abb67-3794-486d-8c1b-9ff37684182a tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:15.495910 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4e6abb67-3794-486d-8c1b-9ff37684182a tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:15.496621 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4e6abb67-3794-486d-8c1b-9ff37684182a tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:15.497615 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4e6abb67-3794-486d-8c1b-9ff37684182a tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:15.498045 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4e6abb67-3794-486d-8c1b-9ff37684182a tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:15.634304 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-4e6abb67-3794-486d-8c1b-9ff37684182a tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:35:15.642716 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-4e6abb67-3794-486d-8c1b-9ff37684182a tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145" status: 200 len: 1266 microversion: 2.1 time: 0.158993 Sep 21 12:35:15.643293 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 532/1079] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:35:15 2022] GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:35:16.667400 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-b32c3bf3-c254-45e3-9dac-1be48b70b21f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:35:16.668029 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-b32c3bf3-c254-45e3-9dac-1be48b70b21f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 2fcab7c0-b348-4709-b520-255e93f2c145] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:35:16.674394 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b32c3bf3-c254-45e3-9dac-1be48b70b21f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:16.674869 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b32c3bf3-c254-45e3-9dac-1be48b70b21f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:16.675302 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b32c3bf3-c254-45e3-9dac-1be48b70b21f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:16.676026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b32c3bf3-c254-45e3-9dac-1be48b70b21f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:16.676478 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b32c3bf3-c254-45e3-9dac-1be48b70b21f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:16.676899 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b32c3bf3-c254-45e3-9dac-1be48b70b21f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:16.808912 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-b32c3bf3-c254-45e3-9dac-1be48b70b21f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:35:16.817028 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-b32c3bf3-c254-45e3-9dac-1be48b70b21f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145" status: 200 len: 1266 microversion: 2.1 time: 0.153549 Sep 21 12:35:16.817603 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 548/1080] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:35:16 2022] GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:35:17.840939 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-5bd0789d-48e0-4f8c-906c-7ca7b415b958 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:35:17.841560 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-5bd0789d-48e0-4f8c-906c-7ca7b415b958 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 2fcab7c0-b348-4709-b520-255e93f2c145] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:35:17.848124 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5bd0789d-48e0-4f8c-906c-7ca7b415b958 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:17.848619 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5bd0789d-48e0-4f8c-906c-7ca7b415b958 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:17.849061 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5bd0789d-48e0-4f8c-906c-7ca7b415b958 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:17.849765 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5bd0789d-48e0-4f8c-906c-7ca7b415b958 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:17.850230 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5bd0789d-48e0-4f8c-906c-7ca7b415b958 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:17.850657 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5bd0789d-48e0-4f8c-906c-7ca7b415b958 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:17.988221 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-5bd0789d-48e0-4f8c-906c-7ca7b415b958 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:35:17.996019 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-5bd0789d-48e0-4f8c-906c-7ca7b415b958 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145" status: 200 len: 1266 microversion: 2.1 time: 0.159396 Sep 21 12:35:17.996630 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 533/1081] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:35:17 2022] GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:35:19.019884 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-00423d02-5dd7-45c3-bc85-2842c3c9415c tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:35:19.020443 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-00423d02-5dd7-45c3-bc85-2842c3c9415c tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 2fcab7c0-b348-4709-b520-255e93f2c145] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:35:19.022928 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell0:SELECT=2 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:35:19.029126 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-00423d02-5dd7-45c3-bc85-2842c3c9415c tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:19.029613 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-00423d02-5dd7-45c3-bc85-2842c3c9415c tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:19.030056 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-00423d02-5dd7-45c3-bc85-2842c3c9415c tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:19.030763 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-00423d02-5dd7-45c3-bc85-2842c3c9415c tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:19.031223 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-00423d02-5dd7-45c3-bc85-2842c3c9415c tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:19.031657 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-00423d02-5dd7-45c3-bc85-2842c3c9415c tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:19.161468 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-00423d02-5dd7-45c3-bc85-2842c3c9415c tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:35:19.169276 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-00423d02-5dd7-45c3-bc85-2842c3c9415c tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145" status: 200 len: 1266 microversion: 2.1 time: 0.153625 Sep 21 12:35:19.169829 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 549/1082] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:35:19 2022] GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:35:20.195653 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-a5d17695-0a2c-4443-86ed-82f5f2f1c0ec tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:35:20.196642 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-a5d17695-0a2c-4443-86ed-82f5f2f1c0ec tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 2fcab7c0-b348-4709-b520-255e93f2c145] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:35:20.200312 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell0:SELECT=2 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:35:20.200962 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell0:SELECT=6 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:35:20.206004 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a5d17695-0a2c-4443-86ed-82f5f2f1c0ec tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:20.206524 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a5d17695-0a2c-4443-86ed-82f5f2f1c0ec tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:20.206969 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a5d17695-0a2c-4443-86ed-82f5f2f1c0ec tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:20.207672 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a5d17695-0a2c-4443-86ed-82f5f2f1c0ec tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:20.208162 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a5d17695-0a2c-4443-86ed-82f5f2f1c0ec tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:20.208596 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a5d17695-0a2c-4443-86ed-82f5f2f1c0ec tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:20.340169 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a5d17695-0a2c-4443-86ed-82f5f2f1c0ec tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:35:20.350057 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-a5d17695-0a2c-4443-86ed-82f5f2f1c0ec tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145" status: 200 len: 1266 microversion: 2.1 time: 0.160633 Sep 21 12:35:20.351057 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 534/1083] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:35:20 2022] GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:35:21.372467 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-bd2dfbd6-8af9-481d-ab62-c0ef27b93d86 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:35:21.373066 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-bd2dfbd6-8af9-481d-ab62-c0ef27b93d86 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 2fcab7c0-b348-4709-b520-255e93f2c145] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:35:21.380011 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bd2dfbd6-8af9-481d-ab62-c0ef27b93d86 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:21.380451 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bd2dfbd6-8af9-481d-ab62-c0ef27b93d86 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:21.380971 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bd2dfbd6-8af9-481d-ab62-c0ef27b93d86 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:21.381655 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bd2dfbd6-8af9-481d-ab62-c0ef27b93d86 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:21.382110 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bd2dfbd6-8af9-481d-ab62-c0ef27b93d86 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:21.382536 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bd2dfbd6-8af9-481d-ab62-c0ef27b93d86 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:21.535087 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-bd2dfbd6-8af9-481d-ab62-c0ef27b93d86 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:35:21.544179 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-bd2dfbd6-8af9-481d-ab62-c0ef27b93d86 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145" status: 200 len: 1266 microversion: 2.1 time: 0.175404 Sep 21 12:35:21.545399 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 550/1084] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:35:21 2022] GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:35:22.568703 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-d8f3385e-388e-45f7-9919-57d56eec0263 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:35:22.569329 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-d8f3385e-388e-45f7-9919-57d56eec0263 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 2fcab7c0-b348-4709-b520-255e93f2c145] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:35:22.575892 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d8f3385e-388e-45f7-9919-57d56eec0263 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:22.576394 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d8f3385e-388e-45f7-9919-57d56eec0263 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:22.576845 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d8f3385e-388e-45f7-9919-57d56eec0263 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:22.577559 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d8f3385e-388e-45f7-9919-57d56eec0263 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:22.578018 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d8f3385e-388e-45f7-9919-57d56eec0263 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:22.578454 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d8f3385e-388e-45f7-9919-57d56eec0263 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:22.706130 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-d8f3385e-388e-45f7-9919-57d56eec0263 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:35:22.714231 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-d8f3385e-388e-45f7-9919-57d56eec0263 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145" status: 200 len: 1266 microversion: 2.1 time: 0.149409 Sep 21 12:35:22.714814 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 535/1085] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:35:22 2022] GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:35:23.052444 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-5b5fe3ef-7886-4e09-8ac4-bad1db6a7b60 req-7add3377-bbe7-46b2-9938-cc11392e1b16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fcab7c0-b348-4709-b520-255e93f2c145", "name": "network-vif-plugged", "status": "completed", "tag": "99db1c1d-12a1-4bd0-be9f-bfda671be9cc"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:35:23.064898 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-5b5fe3ef-7886-4e09-8ac4-bad1db6a7b60 req-7add3377-bbe7-46b2-9938-cc11392e1b16 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:23.065394 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-5b5fe3ef-7886-4e09-8ac4-bad1db6a7b60 req-7add3377-bbe7-46b2-9938-cc11392e1b16 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:23.065835 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-5b5fe3ef-7886-4e09-8ac4-bad1db6a7b60 req-7add3377-bbe7-46b2-9938-cc11392e1b16 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:23.077453 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-5b5fe3ef-7886-4e09-8ac4-bad1db6a7b60 req-7add3377-bbe7-46b2-9938-cc11392e1b16 service nova] Creating event network-vif-plugged:99db1c1d-12a1-4bd0-be9f-bfda671be9cc for instance 2fcab7c0-b348-4709-b520-255e93f2c145 on hv-cinder-85867 Sep 21 12:35:23.083212 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-5b5fe3ef-7886-4e09-8ac4-bad1db6a7b60 req-7add3377-bbe7-46b2-9938-cc11392e1b16 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034110 Sep 21 12:35:23.083842 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 551/1086] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:35:23.737191 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-aa7f45c5-19ae-4dc7-a7cb-fd6da26ef7b0 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:35:23.737745 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-aa7f45c5-19ae-4dc7-a7cb-fd6da26ef7b0 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 2fcab7c0-b348-4709-b520-255e93f2c145] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:35:23.744240 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-aa7f45c5-19ae-4dc7-a7cb-fd6da26ef7b0 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:23.744725 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-aa7f45c5-19ae-4dc7-a7cb-fd6da26ef7b0 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:23.745158 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-aa7f45c5-19ae-4dc7-a7cb-fd6da26ef7b0 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:23.745853 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-aa7f45c5-19ae-4dc7-a7cb-fd6da26ef7b0 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:23.746308 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-aa7f45c5-19ae-4dc7-a7cb-fd6da26ef7b0 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:23.747223 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-aa7f45c5-19ae-4dc7-a7cb-fd6da26ef7b0 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:23.876151 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-aa7f45c5-19ae-4dc7-a7cb-fd6da26ef7b0 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:35:23.883747 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-aa7f45c5-19ae-4dc7-a7cb-fd6da26ef7b0 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145" status: 200 len: 1266 microversion: 2.1 time: 0.150484 Sep 21 12:35:23.884333 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 536/1087] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:35:23 2022] GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:35:24.908824 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-4d4bad63-3fe4-48d7-80df-914fd4596408 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:35:24.909519 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-4d4bad63-3fe4-48d7-80df-914fd4596408 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 2fcab7c0-b348-4709-b520-255e93f2c145] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:35:24.916983 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4d4bad63-3fe4-48d7-80df-914fd4596408 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:24.917470 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4d4bad63-3fe4-48d7-80df-914fd4596408 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:24.917902 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4d4bad63-3fe4-48d7-80df-914fd4596408 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:24.918604 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4d4bad63-3fe4-48d7-80df-914fd4596408 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:24.919058 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4d4bad63-3fe4-48d7-80df-914fd4596408 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:24.919476 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-4d4bad63-3fe4-48d7-80df-914fd4596408 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:25.061999 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-4d4bad63-3fe4-48d7-80df-914fd4596408 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:35:25.069703 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-4d4bad63-3fe4-48d7-80df-914fd4596408 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145" status: 200 len: 1266 microversion: 2.1 time: 0.165052 Sep 21 12:35:25.070259 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 552/1088] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:35:24 2022] GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:35:26.093802 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-a5b93669-7388-421f-b8cf-8d5114b34b5d tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:35:26.094428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-a5b93669-7388-421f-b8cf-8d5114b34b5d tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 2fcab7c0-b348-4709-b520-255e93f2c145] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:35:26.100929 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a5b93669-7388-421f-b8cf-8d5114b34b5d tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:26.101421 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a5b93669-7388-421f-b8cf-8d5114b34b5d tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:26.101867 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a5b93669-7388-421f-b8cf-8d5114b34b5d tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:26.102570 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a5b93669-7388-421f-b8cf-8d5114b34b5d tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:26.103029 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a5b93669-7388-421f-b8cf-8d5114b34b5d tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:26.103463 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-a5b93669-7388-421f-b8cf-8d5114b34b5d tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:26.240443 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-a5b93669-7388-421f-b8cf-8d5114b34b5d tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:35:26.248321 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-a5b93669-7388-421f-b8cf-8d5114b34b5d tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145" status: 200 len: 1453 microversion: 2.1 time: 0.158915 Sep 21 12:35:26.248896 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 537/1089] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:35:26 2022] GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145 => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:35:26.270579 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-f756dbcc-1890-4830-908c-640a0a52997f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:35:26.271200 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-f756dbcc-1890-4830-908c-640a0a52997f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 2fcab7c0-b348-4709-b520-255e93f2c145] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:35:26.277619 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f756dbcc-1890-4830-908c-640a0a52997f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:26.278701 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f756dbcc-1890-4830-908c-640a0a52997f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:26.279141 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f756dbcc-1890-4830-908c-640a0a52997f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:26.279864 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f756dbcc-1890-4830-908c-640a0a52997f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:26.280323 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f756dbcc-1890-4830-908c-640a0a52997f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:26.280748 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f756dbcc-1890-4830-908c-640a0a52997f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:26.410707 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-f756dbcc-1890-4830-908c-640a0a52997f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:35:26.422887 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-f756dbcc-1890-4830-908c-640a0a52997f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145" status: 200 len: 1453 microversion: 2.1 time: 0.156068 Sep 21 12:35:26.423465 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 553/1090] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:35:26 2022] GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:35:28.317691 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-2bd2002f-8ae1-4c23-94f6-29745f9504d2 req-bbf2eb61-0de5-401f-9802-dce7508fb398 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fcab7c0-b348-4709-b520-255e93f2c145", "tag": "99db1c1d-12a1-4bd0-be9f-bfda671be9cc"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:35:28.327719 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-2bd2002f-8ae1-4c23-94f6-29745f9504d2 req-bbf2eb61-0de5-401f-9802-dce7508fb398 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:35:28.328234 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-2bd2002f-8ae1-4c23-94f6-29745f9504d2 req-bbf2eb61-0de5-401f-9802-dce7508fb398 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:35:28.328671 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-2bd2002f-8ae1-4c23-94f6-29745f9504d2 req-bbf2eb61-0de5-401f-9802-dce7508fb398 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:35:28.340454 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-2bd2002f-8ae1-4c23-94f6-29745f9504d2 req-bbf2eb61-0de5-401f-9802-dce7508fb398 service nova] Creating event network-changed:99db1c1d-12a1-4bd0-be9f-bfda671be9cc for instance 2fcab7c0-b348-4709-b520-255e93f2c145 on hv-cinder-85867 Sep 21 12:35:28.345764 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-2bd2002f-8ae1-4c23-94f6-29745f9504d2 req-bbf2eb61-0de5-401f-9802-dce7508fb398 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151320 Sep 21 12:35:28.346591 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 538/1091] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:36:03.496542 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-bb94c99e-ef68-4104-95c6-f0cc11110f64 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:36:03.497194 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-bb94c99e-ef68-4104-95c6-f0cc11110f64 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: a8212565-d87b-4a5a-9618-5f3ad4c9c511] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:36:03.499155 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_api:SELECT=27 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:36:03.499829 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:36:03.506352 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bb94c99e-ef68-4104-95c6-f0cc11110f64 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:03.506828 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bb94c99e-ef68-4104-95c6-f0cc11110f64 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:03.507257 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bb94c99e-ef68-4104-95c6-f0cc11110f64 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:03.507988 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bb94c99e-ef68-4104-95c6-f0cc11110f64 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:03.508433 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bb94c99e-ef68-4104-95c6-f0cc11110f64 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:03.508859 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-bb94c99e-ef68-4104-95c6-f0cc11110f64 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:03.532965 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-bb94c99e-ef68-4104-95c6-f0cc11110f64 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511/ips" status: 200 len: 149 microversion: 2.1 time: 0.040584 Sep 21 12:36:03.533527 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 554/1092] 10.222.0.71 () {58 vars in 1248 bytes} [Wed Sep 21 12:36:03 2022] GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:36:04.864273 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:36:04.865013 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=67 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:36:04.870375 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-132cb3e2-f54f-4e2e-95fb-64f75d5b645c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c1cc9ab-7ad0-4d1a-807b-3779865b5521"}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:36:04.872859 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-132cb3e2-f54f-4e2e-95fb-64f75d5b645c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: a8212565-d87b-4a5a-9618-5f3ad4c9c511] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:36:04.880557 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-132cb3e2-f54f-4e2e-95fb-64f75d5b645c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:04.881083 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-132cb3e2-f54f-4e2e-95fb-64f75d5b645c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:04.881520 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-132cb3e2-f54f-4e2e-95fb-64f75d5b645c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:04.882217 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-132cb3e2-f54f-4e2e-95fb-64f75d5b645c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:04.882672 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-132cb3e2-f54f-4e2e-95fb-64f75d5b645c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:04.883100 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-132cb3e2-f54f-4e2e-95fb-64f75d5b645c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:05.152203 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-132cb3e2-f54f-4e2e-95fb-64f75d5b645c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "POST /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289294 Sep 21 12:36:05.152831 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 539/1093] 10.222.0.71 () {60 vars in 1323 bytes} [Wed Sep 21 12:36:04 2022] POST /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:36:12.697334 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-5ea2d1bf-d005-4ab1-a8c8-399aeddcdbf9 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c1cc9ab-7ad0-4d1a-807b-3779865b5521"}} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:36:12.699778 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-5ea2d1bf-d005-4ab1-a8c8-399aeddcdbf9 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: a8212565-d87b-4a5a-9618-5f3ad4c9c511] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:36:12.705771 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5ea2d1bf-d005-4ab1-a8c8-399aeddcdbf9 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:12.706269 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5ea2d1bf-d005-4ab1-a8c8-399aeddcdbf9 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:12.706710 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5ea2d1bf-d005-4ab1-a8c8-399aeddcdbf9 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:12.707409 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5ea2d1bf-d005-4ab1-a8c8-399aeddcdbf9 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:12.707915 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5ea2d1bf-d005-4ab1-a8c8-399aeddcdbf9 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:12.708333 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5ea2d1bf-d005-4ab1-a8c8-399aeddcdbf9 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:12.884856 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.wsgi [None req-5ea2d1bf-d005-4ab1-a8c8-399aeddcdbf9 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] HTTP exception thrown: Invalid volume: volume 9c1cc9ab-7ad0-4d1a-807b-3779865b5521 is already attached to instances: a8212565-d87b-4a5a-9618-5f3ad4c9c511 Sep 21 12:36:12.886600 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-5ea2d1bf-d005-4ab1-a8c8-399aeddcdbf9 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Request method failure captured: Sep 21 12:36:12.886600 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: request: POST /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511/os-volume_attachments HTTP/1.1 Sep 21 12:36:12.886600 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept: application/json Sep 21 12:36:12.886600 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept-Encoding: identity Sep 21 12:36:12.886600 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Connection: close Sep 21 12:36:12.886600 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Length: 74 Sep 21 12:36:12.886600 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Type: application/json Sep 21 12:36:12.886600 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Host: 10.222.0.71 Sep 21 12:36:12.886600 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Openstack-System-Scope: None Sep 21 12:36:12.886600 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: User-Agent: python-urllib3/1.26.12 Sep 21 12:36:12.886600 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Auth-Token: gAAAAABjKwQbqCTIemwdFFQg4iXhIhsYIA26P2YauPIL4u-NnB6IhqS_YvqFD-8J1npMFI_nNFzmN0CnWmYrRfR3q-kNeYlkoz_mojSbL04ZdZGfD7Us18CZ0XAmBUWJA2QleQStXzvqL0eNZfiCAHfkcyv8CGZMSMlFp6BBl5cDKWdeHuqik0o Sep 21 12:36:12.886600 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Id: None Sep 21 12:36:12.886600 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Name: None Sep 21 12:36:12.886600 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Identity-Status: Confirmed Sep 21 12:36:12.886600 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Is-Admin-Project: True Sep 21 12:36:12.886600 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Id: default Sep 21 12:36:12.886600 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Name: Default Sep 21 12:36:12.886600 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Id: bd7f2ef25e054b619068baf878bead18 Sep 21 12:36:12.886600 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Name: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:36:12.886600 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Role: reader,member Sep 21 12:36:12.886600 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Roles: reader,member Sep 21 12:36:12.888315 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/bd7f2ef25e054b619068baf878bead18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/bd7f2ef25e054b619068baf878bead18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_bd7f2ef25e054b619068baf878bead18", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/bd7f2ef25e054b619068baf878bead18"}]}] Sep 21 12:36:12.888315 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:36:12.888315 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Id: bd7f2ef25e054b619068baf878bead18 Sep 21 12:36:12.888315 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:36:12.888315 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User: tempest-AttachVolumeNegativeTest-367231197-project Sep 21 12:36:12.888315 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Id: default Sep 21 12:36:12.888315 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Name: Default Sep 21 12:36:12.888315 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Id: 90d4dfe489634f3c9346b0ab86408e3b Sep 21 12:36:12.888315 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Name: tempest-AttachVolumeNegativeTest-367231197-project Sep 21 12:36:12.888315 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Sep 21 12:36:12.888315 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: {"volumeAttachment": {"volumeId": "9c1cc9ab-7ad0-4d1a-807b-3779865b5521"}} Sep 21 12:36:12.888315 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: method: > Sep 21 12:36:12.889232 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: exception: Invalid volume: volume 9c1cc9ab-7ad0-4d1a-807b-3779865b5521 is already attached to instances: a8212565-d87b-4a5a-9618-5f3ad4c9c511 Sep 21 12:36:12.889232 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: action_args: {'server_id': 'a8212565-d87b-4a5a-9618-5f3ad4c9c511', 'body': {'volumeAttachment': {'volumeId': '9c1cc9ab-7ad0-4d1a-807b-3779865b5521'}}} Sep 21 12:36:12.889232 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:36:12.889232 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:36:12.889232 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 21 12:36:12.889232 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 21 12:36:12.889232 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 21 12:36:12.889232 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 21 12:36:12.889232 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 21 12:36:12.889232 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 21 12:36:12.889232 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 21 12:36:12.889232 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 21 12:36:12.889232 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 21 12:36:12.889232 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 21 12:36:12.889232 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9c1cc9ab-7ad0-4d1a-807b-3779865b5521 is already attached to instances: a8212565-d87b-4a5a-9618-5f3ad4c9c511 Sep 21 12:36:12.889232 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:36:12.889232 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:36:12.889232 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:36:12.889232 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:36:12.890505 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:36:12.890505 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:36:12.890505 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:36:12.890505 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:36:12.890505 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:36:12.890505 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:36:12.890505 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 21 12:36:12.890505 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 21 12:36:12.890505 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 21 12:36:12.890505 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 21 12:36:12.890505 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 21 12:36:12.890505 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 21 12:36:12.890505 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 21 12:36:12.890505 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 21 12:36:12.890505 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9c1cc9ab-7ad0-4d1a-807b-3779865b5521 is already attached to instances: a8212565-d87b-4a5a-9618-5f3ad4c9c511 Sep 21 12:36:12.890505 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:36:12.890505 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:36:12.890505 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:36:12.890505 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:36:12.890505 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:36:12.892406 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:36:12.892406 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:36:12.892406 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:36:12.892406 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9c1cc9ab-7ad0-4d1a-807b-3779865b5521 is already attached to instances: a8212565-d87b-4a5a-9618-5f3ad4c9c511 Sep 21 12:36:12.892406 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:36:12.892406 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-5ea2d1bf-d005-4ab1-a8c8-399aeddcdbf9 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Returning 400 to user: Invalid volume: volume 9c1cc9ab-7ad0-4d1a-807b-3779865b5521 is already attached to instances: a8212565-d87b-4a5a-9618-5f3ad4c9c511 {{(pid=120462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:36:12.892406 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-5ea2d1bf-d005-4ab1-a8c8-399aeddcdbf9 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "POST /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.194960 Sep 21 12:36:12.892406 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 555/1094] 10.222.0.71 () {60 vars in 1323 bytes} [Wed Sep 21 12:36:12 2022] POST /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511/os-volume_attachments => generated 174 bytes in 196 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 21 12:36:12.954854 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-ad59b4ea-dcea-4a77-a40a-20f07136df1d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:36:12.955447 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-ad59b4ea-dcea-4a77-a40a-20f07136df1d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: a8212565-d87b-4a5a-9618-5f3ad4c9c511] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:36:12.962508 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ad59b4ea-dcea-4a77-a40a-20f07136df1d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:12.962994 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ad59b4ea-dcea-4a77-a40a-20f07136df1d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:12.963440 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ad59b4ea-dcea-4a77-a40a-20f07136df1d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:12.964172 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ad59b4ea-dcea-4a77-a40a-20f07136df1d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:12.964640 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ad59b4ea-dcea-4a77-a40a-20f07136df1d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:12.965072 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ad59b4ea-dcea-4a77-a40a-20f07136df1d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:13.094569 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.objects.instance [None req-ad59b4ea-dcea-4a77-a40a-20f07136df1d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lazy-loading 'services' on Instance uuid a8212565-d87b-4a5a-9618-5f3ad4c9c511 {{(pid=120463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 12:36:13.166065 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-ad59b4ea-dcea-4a77-a40a-20f07136df1d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "DELETE /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511/os-volume_attachments/9c1cc9ab-7ad0-4d1a-807b-3779865b5521" status: 202 len: 0 microversion: 2.1 time: 0.215921 Sep 21 12:36:13.166664 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 540/1095] 10.222.0.71 () {58 vars in 1416 bytes} [Wed Sep 21 12:36:12 2022] DELETE /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511/os-volume_attachments/9c1cc9ab-7ad0-4d1a-807b-3779865b5521 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 12:36:13.174986 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-7b7ba423-d9cd-44ad-8936-a0e1c09b5cb8 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:36:13.177264 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-7b7ba423-d9cd-44ad-8936-a0e1c09b5cb8 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: a8212565-d87b-4a5a-9618-5f3ad4c9c511] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:36:13.186540 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7b7ba423-d9cd-44ad-8936-a0e1c09b5cb8 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:13.187086 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7b7ba423-d9cd-44ad-8936-a0e1c09b5cb8 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:13.187544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7b7ba423-d9cd-44ad-8936-a0e1c09b5cb8 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:13.188299 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7b7ba423-d9cd-44ad-8936-a0e1c09b5cb8 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:13.188761 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7b7ba423-d9cd-44ad-8936-a0e1c09b5cb8 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:13.189195 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-7b7ba423-d9cd-44ad-8936-a0e1c09b5cb8 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:13.219308 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-7b7ba423-d9cd-44ad-8936-a0e1c09b5cb8 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048220 Sep 21 12:36:13.219926 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 556/1096] 10.222.0.71 () {58 vars in 1302 bytes} [Wed Sep 21 12:36:13 2022] GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:36:14.232613 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-4b610f40-7bb3-43dc-8991-5b6d8120aec5 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:36:14.234892 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-4b610f40-7bb3-43dc-8991-5b6d8120aec5 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: a8212565-d87b-4a5a-9618-5f3ad4c9c511] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:36:14.242255 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4b610f40-7bb3-43dc-8991-5b6d8120aec5 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:14.242748 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4b610f40-7bb3-43dc-8991-5b6d8120aec5 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:14.243191 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4b610f40-7bb3-43dc-8991-5b6d8120aec5 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:14.243923 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4b610f40-7bb3-43dc-8991-5b6d8120aec5 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:14.244384 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4b610f40-7bb3-43dc-8991-5b6d8120aec5 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:14.244825 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4b610f40-7bb3-43dc-8991-5b6d8120aec5 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:14.273482 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-4b610f40-7bb3-43dc-8991-5b6d8120aec5 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045338 Sep 21 12:36:14.274048 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 541/1097] 10.222.0.71 () {58 vars in 1302 bytes} [Wed Sep 21 12:36:14 2022] GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 21 12:36:14.338926 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-082a1f6a-d0b4-4ed3-a794-e26c782d9b46 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:36:14.340097 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-082a1f6a-d0b4-4ed3-a794-e26c782d9b46 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: a8212565-d87b-4a5a-9618-5f3ad4c9c511] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:36:14.347299 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-082a1f6a-d0b4-4ed3-a794-e26c782d9b46 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:14.347824 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-082a1f6a-d0b4-4ed3-a794-e26c782d9b46 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:14.348275 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-082a1f6a-d0b4-4ed3-a794-e26c782d9b46 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:14.348975 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-082a1f6a-d0b4-4ed3-a794-e26c782d9b46 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:14.349435 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-082a1f6a-d0b4-4ed3-a794-e26c782d9b46 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:14.349866 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-082a1f6a-d0b4-4ed3-a794-e26c782d9b46 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:14.375091 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-082a1f6a-d0b4-4ed3-a794-e26c782d9b46 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: a8212565-d87b-4a5a-9618-5f3ad4c9c511] Going to try to terminate instance {{(pid=120462) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 12:36:14.450844 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-082a1f6a-d0b4-4ed3-a794-e26c782d9b46 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "DELETE /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511" status: 204 len: 0 microversion: 2.1 time: 0.116017 Sep 21 12:36:14.451629 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 557/1098] 10.222.0.71 () {58 vars in 1239 bytes} [Wed Sep 21 12:36:14 2022] DELETE /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 21 12:36:14.460613 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-86eb8a83-03d3-4580-ad6a-109c3d730599 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:36:14.461538 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-86eb8a83-03d3-4580-ad6a-109c3d730599 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: a8212565-d87b-4a5a-9618-5f3ad4c9c511] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:36:14.467464 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-86eb8a83-03d3-4580-ad6a-109c3d730599 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:14.467994 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-86eb8a83-03d3-4580-ad6a-109c3d730599 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:14.468465 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-86eb8a83-03d3-4580-ad6a-109c3d730599 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:14.469156 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-86eb8a83-03d3-4580-ad6a-109c3d730599 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:14.469613 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-86eb8a83-03d3-4580-ad6a-109c3d730599 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:14.470044 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-86eb8a83-03d3-4580-ad6a-109c3d730599 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:14.596807 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-86eb8a83-03d3-4580-ad6a-109c3d730599 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:36:14.605142 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-86eb8a83-03d3-4580-ad6a-109c3d730599 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511" status: 200 len: 1680 microversion: 2.1 time: 0.149031 Sep 21 12:36:14.605745 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 542/1099] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:36:14 2022] GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:36:15.630075 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-fadb635c-c421-44f1-85a4-20e9d8b19130 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:36:15.634241 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-fadb635c-c421-44f1-85a4-20e9d8b19130 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: a8212565-d87b-4a5a-9618-5f3ad4c9c511] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:36:15.641190 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fadb635c-c421-44f1-85a4-20e9d8b19130 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:15.641688 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fadb635c-c421-44f1-85a4-20e9d8b19130 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:15.642106 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fadb635c-c421-44f1-85a4-20e9d8b19130 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:15.642804 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fadb635c-c421-44f1-85a4-20e9d8b19130 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:15.643256 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fadb635c-c421-44f1-85a4-20e9d8b19130 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:15.643679 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fadb635c-c421-44f1-85a4-20e9d8b19130 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:15.775017 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-fadb635c-c421-44f1-85a4-20e9d8b19130 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:36:15.782732 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-fadb635c-c421-44f1-85a4-20e9d8b19130 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511" status: 200 len: 1680 microversion: 2.1 time: 0.157979 Sep 21 12:36:15.783382 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 558/1100] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:36:15 2022] GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:36:16.807090 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-9f91eb7b-eae3-4e87-adc1-259742d1fcd3 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:36:16.807718 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-9f91eb7b-eae3-4e87-adc1-259742d1fcd3 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: a8212565-d87b-4a5a-9618-5f3ad4c9c511] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:36:16.814341 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9f91eb7b-eae3-4e87-adc1-259742d1fcd3 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:16.814832 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9f91eb7b-eae3-4e87-adc1-259742d1fcd3 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:16.815281 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9f91eb7b-eae3-4e87-adc1-259742d1fcd3 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:16.816592 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9f91eb7b-eae3-4e87-adc1-259742d1fcd3 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:16.817065 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9f91eb7b-eae3-4e87-adc1-259742d1fcd3 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:16.817491 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9f91eb7b-eae3-4e87-adc1-259742d1fcd3 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:16.952967 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-9f91eb7b-eae3-4e87-adc1-259742d1fcd3 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:36:16.962736 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-9f91eb7b-eae3-4e87-adc1-259742d1fcd3 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511" status: 200 len: 1680 microversion: 2.1 time: 0.159523 Sep 21 12:36:16.963550 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 543/1101] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:36:16 2022] GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:36:17.215349 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-00359e59-b166-4aa4-b510-1616ac13a6d4 req-a699f975-26b8-4519-af9a-1c7df18900c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8212565-d87b-4a5a-9618-5f3ad4c9c511", "name": "network-vif-deleted", "tag": "799ca1ff-f8e5-41fd-88f7-cb9c9a83b5ed"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:36:17.227157 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-00359e59-b166-4aa4-b510-1616ac13a6d4 req-a699f975-26b8-4519-af9a-1c7df18900c3 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:17.227748 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-00359e59-b166-4aa4-b510-1616ac13a6d4 req-a699f975-26b8-4519-af9a-1c7df18900c3 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:17.228295 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-00359e59-b166-4aa4-b510-1616ac13a6d4 req-a699f975-26b8-4519-af9a-1c7df18900c3 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:17.240612 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-00359e59-b166-4aa4-b510-1616ac13a6d4 req-a699f975-26b8-4519-af9a-1c7df18900c3 service nova] Creating event network-vif-deleted:799ca1ff-f8e5-41fd-88f7-cb9c9a83b5ed for instance a8212565-d87b-4a5a-9618-5f3ad4c9c511 on hv-cinder-85867 Sep 21 12:36:17.246274 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-00359e59-b166-4aa4-b510-1616ac13a6d4 req-a699f975-26b8-4519-af9a-1c7df18900c3 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034936 Sep 21 12:36:17.247139 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 559/1102] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 12:36:17.986186 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-b2cf3376-f64a-4e40-b6b1-543ea5a62f52 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:36:17.986807 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-b2cf3376-f64a-4e40-b6b1-543ea5a62f52 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: a8212565-d87b-4a5a-9618-5f3ad4c9c511] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:36:17.995288 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b2cf3376-f64a-4e40-b6b1-543ea5a62f52 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:17.995901 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b2cf3376-f64a-4e40-b6b1-543ea5a62f52 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:17.996372 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b2cf3376-f64a-4e40-b6b1-543ea5a62f52 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:17.997086 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b2cf3376-f64a-4e40-b6b1-543ea5a62f52 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:17.997554 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b2cf3376-f64a-4e40-b6b1-543ea5a62f52 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:17.997993 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b2cf3376-f64a-4e40-b6b1-543ea5a62f52 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:18.012930 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.wsgi [None req-b2cf3376-f64a-4e40-b6b1-543ea5a62f52 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] HTTP exception thrown: Instance a8212565-d87b-4a5a-9618-5f3ad4c9c511 could not be found. Sep 21 12:36:18.014659 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-b2cf3376-f64a-4e40-b6b1-543ea5a62f52 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Request method failure captured: Sep 21 12:36:18.014659 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: request: GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511 HTTP/1.1 Sep 21 12:36:18.014659 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept: application/json Sep 21 12:36:18.014659 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept-Encoding: identity Sep 21 12:36:18.014659 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Connection: close Sep 21 12:36:18.014659 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Length: 0 Sep 21 12:36:18.014659 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Type: application/json Sep 21 12:36:18.014659 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Host: 10.222.0.71 Sep 21 12:36:18.014659 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Openstack-System-Scope: None Sep 21 12:36:18.014659 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: User-Agent: python-urllib3/1.26.12 Sep 21 12:36:18.014659 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Auth-Token: gAAAAABjKwQbqCTIemwdFFQg4iXhIhsYIA26P2YauPIL4u-NnB6IhqS_YvqFD-8J1npMFI_nNFzmN0CnWmYrRfR3q-kNeYlkoz_mojSbL04ZdZGfD7Us18CZ0XAmBUWJA2QleQStXzvqL0eNZfiCAHfkcyv8CGZMSMlFp6BBl5cDKWdeHuqik0o Sep 21 12:36:18.014659 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Id: None Sep 21 12:36:18.014659 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Name: None Sep 21 12:36:18.014659 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Identity-Status: Confirmed Sep 21 12:36:18.014659 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Is-Admin-Project: True Sep 21 12:36:18.014659 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Id: default Sep 21 12:36:18.014659 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Name: Default Sep 21 12:36:18.014659 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Id: bd7f2ef25e054b619068baf878bead18 Sep 21 12:36:18.014659 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Name: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:36:18.014659 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Role: reader,member Sep 21 12:36:18.014659 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Roles: reader,member Sep 21 12:36:18.016432 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/bd7f2ef25e054b619068baf878bead18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/bd7f2ef25e054b619068baf878bead18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_bd7f2ef25e054b619068baf878bead18", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/bd7f2ef25e054b619068baf878bead18"}]}] Sep 21 12:36:18.016432 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:36:18.016432 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Id: bd7f2ef25e054b619068baf878bead18 Sep 21 12:36:18.016432 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:36:18.016432 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User: tempest-AttachVolumeNegativeTest-367231197-project Sep 21 12:36:18.016432 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Id: default Sep 21 12:36:18.016432 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Name: Default Sep 21 12:36:18.016432 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Id: 90d4dfe489634f3c9346b0ab86408e3b Sep 21 12:36:18.016432 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Name: tempest-AttachVolumeNegativeTest-367231197-project Sep 21 12:36:18.016432 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: method: > Sep 21 12:36:18.016432 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: exception: Instance a8212565-d87b-4a5a-9618-5f3ad4c9c511 could not be found. Sep 21 12:36:18.016432 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: action_args: {'id': 'a8212565-d87b-4a5a-9618-5f3ad4c9c511'} Sep 21 12:36:18.017251 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:36:18.017251 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:36:18.017251 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:36:18.017251 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:36:18.017251 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:36:18.017251 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:36:18.017251 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:36:18.017251 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:36:18.017251 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:36:18.017251 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:36:18.017251 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8212565-d87b-4a5a-9618-5f3ad4c9c511 could not be found. Sep 21 12:36:18.017251 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:36:18.017251 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:36:18.017251 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:36:18.017251 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:36:18.017251 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:36:18.017251 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:36:18.017251 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:36:18.017251 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:36:18.017251 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:36:18.018581 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:36:18.018581 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 12:36:18.018581 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 12:36:18.018581 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:36:18.018581 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:36:18.018581 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:36:18.018581 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:36:18.018581 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8212565-d87b-4a5a-9618-5f3ad4c9c511 could not be found. Sep 21 12:36:18.018581 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:36:18.018581 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:36:18.018581 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:36:18.018581 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:36:18.018581 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:36:18.018581 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:36:18.018581 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:36:18.018581 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:36:18.018581 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8212565-d87b-4a5a-9618-5f3ad4c9c511 could not be found. Sep 21 12:36:18.018581 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:36:18.020376 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-b2cf3376-f64a-4e40-b6b1-543ea5a62f52 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Returning 404 to user: Instance a8212565-d87b-4a5a-9618-5f3ad4c9c511 could not be found. {{(pid=120463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:36:18.020376 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-b2cf3376-f64a-4e40-b6b1-543ea5a62f52 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511" status: 404 len: 111 microversion: 2.1 time: 0.033865 Sep 21 12:36:18.020376 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 544/1103] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:36:17 2022] GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:36:18.026690 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-90ca56f2-e7d7-4b73-ab2d-2ac425614307 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '.version_select at 0x7fe4cc7c38b0>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:36:18.047140 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-90ca56f2-e7d7-4b73-ab2d-2ac425614307 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-753366204" status: 202 len: 0 microversion: 2.1 time: 0.024816 Sep 21 12:36:18.047887 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 560/1104] 10.222.0.71 () {58 vars in 1218 bytes} [Wed Sep 21 12:36:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-753366204 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 12:36:18.690608 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-b2f2ea2a-df18-4862-920f-861515a7e200 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Action: 'create', calling method: .version_select at 0x7fe4c8d8b940>, body: {"keypair": {"name": "tempest-keypair-1365059727", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHl0094YPsz7N2Lsf6ICssp3EWSPX7oqq7LiH45yW3MaQ7t6N+yxYmPn6TXcd9Wuzit0+45f8WondHe/NEQbw/wJwRW5N42yIh3Fofjq3NslIq38y7k7+MSdETnkXsZKCQ=="}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:36:18.707861 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.quota [None req-b2f2ea2a-df18-4862-920f-861515a7e200 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Getting quotas for project bd7f2ef25e054b619068baf878bead18. Resources: {'key_pairs'} {{(pid=120463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 12:36:18.712892 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.quota [None req-b2f2ea2a-df18-4862-920f-861515a7e200 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Getting quotas for user 90d4dfe489634f3c9346b0ab86408e3b and project bd7f2ef25e054b619068baf878bead18. Resources: {'key_pairs'} {{(pid=120463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 12:36:18.738614 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-b2f2ea2a-df18-4862-920f-861515a7e200 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052064 Sep 21 12:36:18.739357 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 545/1105] 10.222.0.71 () {60 vars in 1159 bytes} [Wed Sep 21 12:36:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 12:36:19.946712 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-ca5306cf-f2b1-4468-b019-66816c4de764 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-140924302", "imageRef": "1e3a8d95-6338-499c-af91-e3d1345af950", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8f74bce-cdd1-4f64-9fe4-35f38581a3e4"}], "security_groups": [{"name": "tempest-securitygroup--1395215286"}], "key_name": "tempest-keypair-1365059727", "user_data": "}} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:36:20.048731 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.network.neutron [None req-ca5306cf-f2b1-4468-b019-66816c4de764 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] validate_networks() for [('e8f74bce-cdd1-4f64-9fe4-35f38581a3e4', None, None, None, None, None)] {{(pid=120462) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 12:36:20.424406 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-ca5306cf-f2b1-4468-b019-66816c4de764 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Flavor limits 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 12:36:20.424834 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-ca5306cf-f2b1-4468-b019-66816c4de764 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Image limits 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 12:36:20.425418 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-ca5306cf-f2b1-4468-b019-66816c4de764 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Flavor pref 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 12:36:20.425831 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-ca5306cf-f2b1-4468-b019-66816c4de764 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Image pref 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 12:36:20.426247 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-ca5306cf-f2b1-4468-b019-66816c4de764 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 12:36:20.434913 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ca5306cf-f2b1-4468-b019-66816c4de764 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:20.435395 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ca5306cf-f2b1-4468-b019-66816c4de764 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:20.435869 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ca5306cf-f2b1-4468-b019-66816c4de764 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:20.436602 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ca5306cf-f2b1-4468-b019-66816c4de764 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:20.437059 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ca5306cf-f2b1-4468-b019-66816c4de764 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:20.437486 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ca5306cf-f2b1-4468-b019-66816c4de764 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:20.453799 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-ca5306cf-f2b1-4468-b019-66816c4de764 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Getting quotas for project bd7f2ef25e054b619068baf878bead18. Resources: {'instances', 'ram', 'cores'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 12:36:20.458242 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-ca5306cf-f2b1-4468-b019-66816c4de764 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Getting quotas for user 90d4dfe489634f3c9346b0ab86408e3b and project bd7f2ef25e054b619068baf878bead18. Resources: {'instances', 'ram', 'cores'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 12:36:20.469317 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-ca5306cf-f2b1-4468-b019-66816c4de764 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Going to run 1 instances... {{(pid=120462) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 12:36:20.471671 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-ca5306cf-f2b1-4468-b019-66816c4de764 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e3a8d95-6338-499c-af91-e3d1345af950',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 12:36:20.521384 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-ca5306cf-f2b1-4468-b019-66816c4de764 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.579360 Sep 21 12:36:20.522037 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 561/1106] 10.222.0.71 () {60 vars in 1147 bytes} [Wed Sep 21 12:36:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 21 12:36:20.533566 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-8a2873c4-64b9-4ac2-8cf1-2507008bff22 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:36:20.534192 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-8a2873c4-64b9-4ac2-8cf1-2507008bff22 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:36:20.591246 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-8a2873c4-64b9-4ac2-8cf1-2507008bff22 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:36:20.598814 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-8a2873c4-64b9-4ac2-8cf1-2507008bff22 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c" status: 200 len: 1241 microversion: 2.1 time: 0.069560 Sep 21 12:36:20.599400 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 546/1107] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:36:20 2022] GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:36:21.623357 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-152dfed6-beb9-4e8d-a069-7ce746f97b76 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:36:21.624281 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-152dfed6-beb9-4e8d-a069-7ce746f97b76 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:36:21.631046 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-152dfed6-beb9-4e8d-a069-7ce746f97b76 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:21.631655 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-152dfed6-beb9-4e8d-a069-7ce746f97b76 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:21.632190 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-152dfed6-beb9-4e8d-a069-7ce746f97b76 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:21.632971 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-152dfed6-beb9-4e8d-a069-7ce746f97b76 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:21.633529 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-152dfed6-beb9-4e8d-a069-7ce746f97b76 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:21.634018 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-152dfed6-beb9-4e8d-a069-7ce746f97b76 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:21.715173 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-152dfed6-beb9-4e8d-a069-7ce746f97b76 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:36:21.725621 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-152dfed6-beb9-4e8d-a069-7ce746f97b76 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c" status: 200 len: 1301 microversion: 2.1 time: 0.107700 Sep 21 12:36:21.726604 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 562/1108] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:36:21 2022] GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c => generated 1301 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:36:22.803792 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-5fed033e-6cad-4324-896e-026563ab234e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:36:22.804543 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-5fed033e-6cad-4324-896e-026563ab234e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:36:22.810854 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5fed033e-6cad-4324-896e-026563ab234e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:22.811351 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5fed033e-6cad-4324-896e-026563ab234e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:22.811825 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5fed033e-6cad-4324-896e-026563ab234e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:22.812550 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5fed033e-6cad-4324-896e-026563ab234e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:22.813007 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5fed033e-6cad-4324-896e-026563ab234e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:22.813496 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5fed033e-6cad-4324-896e-026563ab234e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:22.951514 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-5fed033e-6cad-4324-896e-026563ab234e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:36:22.960495 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-5fed033e-6cad-4324-896e-026563ab234e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c" status: 200 len: 1367 microversion: 2.1 time: 0.214483 Sep 21 12:36:22.961331 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 547/1109] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:36:22 2022] GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:36:23.411533 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-b98e4d62-7644-4659-90a2-d5ec4a04f090 req-a454cd2f-2725-4eb2-aca6-3c0c9a03136a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c", "tag": "ba672dd3-4a5b-4ddf-bc85-e9f599fa0552"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:36:23.428347 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-b98e4d62-7644-4659-90a2-d5ec4a04f090 req-a454cd2f-2725-4eb2-aca6-3c0c9a03136a service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:23.431967 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-b98e4d62-7644-4659-90a2-d5ec4a04f090 req-a454cd2f-2725-4eb2-aca6-3c0c9a03136a service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:23.431967 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-b98e4d62-7644-4659-90a2-d5ec4a04f090 req-a454cd2f-2725-4eb2-aca6-3c0c9a03136a service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:23.454706 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-b98e4d62-7644-4659-90a2-d5ec4a04f090 req-a454cd2f-2725-4eb2-aca6-3c0c9a03136a service nova] Creating event network-changed:ba672dd3-4a5b-4ddf-bc85-e9f599fa0552 for instance 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c on hv-cinder-85867 Sep 21 12:36:23.458782 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-b98e4d62-7644-4659-90a2-d5ec4a04f090 req-a454cd2f-2725-4eb2-aca6-3c0c9a03136a service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051941 Sep 21 12:36:23.459845 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 563/1110] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:36:23.984192 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-cffbd285-35ff-4604-a114-b28e791e479f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:36:23.984728 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-cffbd285-35ff-4604-a114-b28e791e479f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:36:23.991704 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cffbd285-35ff-4604-a114-b28e791e479f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:23.992229 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cffbd285-35ff-4604-a114-b28e791e479f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:23.992672 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cffbd285-35ff-4604-a114-b28e791e479f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:23.993378 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cffbd285-35ff-4604-a114-b28e791e479f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:23.993846 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cffbd285-35ff-4604-a114-b28e791e479f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:23.994275 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cffbd285-35ff-4604-a114-b28e791e479f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:24.129634 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-cffbd285-35ff-4604-a114-b28e791e479f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:36:24.140269 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-cffbd285-35ff-4604-a114-b28e791e479f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c" status: 200 len: 1367 microversion: 2.1 time: 0.160075 Sep 21 12:36:24.140865 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 548/1111] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:36:23 2022] GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:36:25.167994 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-5ea99b86-1250-4b3f-bdc9-ada855b15eeb tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:36:25.168730 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-5ea99b86-1250-4b3f-bdc9-ada855b15eeb tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:36:25.175051 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5ea99b86-1250-4b3f-bdc9-ada855b15eeb tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:25.175536 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5ea99b86-1250-4b3f-bdc9-ada855b15eeb tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:25.175999 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5ea99b86-1250-4b3f-bdc9-ada855b15eeb tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:25.176698 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5ea99b86-1250-4b3f-bdc9-ada855b15eeb tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:25.177156 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5ea99b86-1250-4b3f-bdc9-ada855b15eeb tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:25.177583 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5ea99b86-1250-4b3f-bdc9-ada855b15eeb tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:25.306935 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-5ea99b86-1250-4b3f-bdc9-ada855b15eeb tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:36:25.314782 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-5ea99b86-1250-4b3f-bdc9-ada855b15eeb tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c" status: 200 len: 1367 microversion: 2.1 time: 0.151576 Sep 21 12:36:25.316428 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 564/1112] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:36:25 2022] GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:36:26.338730 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-ac1973c2-a3c4-4679-be14-a463b7fedca0 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:36:26.339410 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-ac1973c2-a3c4-4679-be14-a463b7fedca0 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:36:26.346014 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ac1973c2-a3c4-4679-be14-a463b7fedca0 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:26.346512 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ac1973c2-a3c4-4679-be14-a463b7fedca0 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:26.346992 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ac1973c2-a3c4-4679-be14-a463b7fedca0 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:26.347699 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ac1973c2-a3c4-4679-be14-a463b7fedca0 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:26.348197 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ac1973c2-a3c4-4679-be14-a463b7fedca0 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:26.348631 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ac1973c2-a3c4-4679-be14-a463b7fedca0 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:26.481868 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-ac1973c2-a3c4-4679-be14-a463b7fedca0 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:36:26.490105 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-ac1973c2-a3c4-4679-be14-a463b7fedca0 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c" status: 200 len: 1367 microversion: 2.1 time: 0.155543 Sep 21 12:36:26.490687 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 549/1113] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:36:26 2022] GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:36:27.513906 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-257b5ec1-31f4-4ea9-93c7-daf9d1a6f12b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:36:27.514640 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-257b5ec1-31f4-4ea9-93c7-daf9d1a6f12b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:36:27.521646 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-257b5ec1-31f4-4ea9-93c7-daf9d1a6f12b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:27.522132 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-257b5ec1-31f4-4ea9-93c7-daf9d1a6f12b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:27.522589 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-257b5ec1-31f4-4ea9-93c7-daf9d1a6f12b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:27.523284 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-257b5ec1-31f4-4ea9-93c7-daf9d1a6f12b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:27.523736 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-257b5ec1-31f4-4ea9-93c7-daf9d1a6f12b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:27.524187 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-257b5ec1-31f4-4ea9-93c7-daf9d1a6f12b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:27.659155 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-257b5ec1-31f4-4ea9-93c7-daf9d1a6f12b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:36:27.667473 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-257b5ec1-31f4-4ea9-93c7-daf9d1a6f12b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c" status: 200 len: 1367 microversion: 2.1 time: 0.157472 Sep 21 12:36:27.668095 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 565/1114] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:36:27 2022] GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:36:28.690876 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-f70ca717-17b8-4402-8300-bc9dc8bfb73c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:36:28.691480 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-f70ca717-17b8-4402-8300-bc9dc8bfb73c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:36:28.698570 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f70ca717-17b8-4402-8300-bc9dc8bfb73c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:28.699057 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f70ca717-17b8-4402-8300-bc9dc8bfb73c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:28.699484 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f70ca717-17b8-4402-8300-bc9dc8bfb73c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:28.700195 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f70ca717-17b8-4402-8300-bc9dc8bfb73c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:28.700646 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f70ca717-17b8-4402-8300-bc9dc8bfb73c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:28.701070 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f70ca717-17b8-4402-8300-bc9dc8bfb73c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:28.827413 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-f70ca717-17b8-4402-8300-bc9dc8bfb73c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:36:28.835966 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-f70ca717-17b8-4402-8300-bc9dc8bfb73c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c" status: 200 len: 1367 microversion: 2.1 time: 0.148898 Sep 21 12:36:28.836808 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 550/1115] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:36:28 2022] GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:36:29.346235 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-a796565d-d376-4d9d-8bc9-674175867a55 req-e621b5d8-59b8-4e8e-bd5f-c30ae4efc5c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c", "name": "network-vif-plugged", "status": "completed", "tag": "ba672dd3-4a5b-4ddf-bc85-e9f599fa0552"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:36:29.358675 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-a796565d-d376-4d9d-8bc9-674175867a55 req-e621b5d8-59b8-4e8e-bd5f-c30ae4efc5c4 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:29.359162 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-a796565d-d376-4d9d-8bc9-674175867a55 req-e621b5d8-59b8-4e8e-bd5f-c30ae4efc5c4 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:29.359861 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-a796565d-d376-4d9d-8bc9-674175867a55 req-e621b5d8-59b8-4e8e-bd5f-c30ae4efc5c4 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:29.372013 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-a796565d-d376-4d9d-8bc9-674175867a55 req-e621b5d8-59b8-4e8e-bd5f-c30ae4efc5c4 service nova] Creating event network-vif-plugged:ba672dd3-4a5b-4ddf-bc85-e9f599fa0552 for instance 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c on hv-cinder-85867 Sep 21 12:36:29.377625 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-a796565d-d376-4d9d-8bc9-674175867a55 req-e621b5d8-59b8-4e8e-bd5f-c30ae4efc5c4 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035145 Sep 21 12:36:29.378230 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 566/1116] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:36:29.859967 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-6ad11842-c833-4eff-b05e-3599f3fedf95 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:36:29.860505 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-6ad11842-c833-4eff-b05e-3599f3fedf95 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:36:29.867413 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6ad11842-c833-4eff-b05e-3599f3fedf95 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:29.867925 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6ad11842-c833-4eff-b05e-3599f3fedf95 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:29.868368 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6ad11842-c833-4eff-b05e-3599f3fedf95 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:29.869057 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6ad11842-c833-4eff-b05e-3599f3fedf95 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:29.869505 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6ad11842-c833-4eff-b05e-3599f3fedf95 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:29.869930 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6ad11842-c833-4eff-b05e-3599f3fedf95 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:29.997752 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-6ad11842-c833-4eff-b05e-3599f3fedf95 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:36:30.005875 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-6ad11842-c833-4eff-b05e-3599f3fedf95 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c" status: 200 len: 1367 microversion: 2.1 time: 0.149914 Sep 21 12:36:30.006452 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 551/1117] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:36:29 2022] GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:36:31.030050 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-fc329fa3-d7f4-4037-9cca-3cacef877c9c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:36:31.030765 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-fc329fa3-d7f4-4037-9cca-3cacef877c9c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:36:31.033135 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell0:SELECT=2 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:36:31.033787 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell0:SELECT=6 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:36:31.040304 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fc329fa3-d7f4-4037-9cca-3cacef877c9c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:31.040781 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fc329fa3-d7f4-4037-9cca-3cacef877c9c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:31.041213 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fc329fa3-d7f4-4037-9cca-3cacef877c9c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:31.041905 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fc329fa3-d7f4-4037-9cca-3cacef877c9c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:31.042350 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fc329fa3-d7f4-4037-9cca-3cacef877c9c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:31.042770 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-fc329fa3-d7f4-4037-9cca-3cacef877c9c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:31.178323 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-fc329fa3-d7f4-4037-9cca-3cacef877c9c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:36:31.186270 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-fc329fa3-d7f4-4037-9cca-3cacef877c9c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c" status: 200 len: 1367 microversion: 2.1 time: 0.160624 Sep 21 12:36:31.186849 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 567/1118] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:36:31 2022] GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:36:32.211090 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-2f7e5824-273b-4443-b3d0-7f28dddf628c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:36:32.211996 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-2f7e5824-273b-4443-b3d0-7f28dddf628c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:36:32.213997 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell0:SELECT=6 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:36:32.219466 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2f7e5824-273b-4443-b3d0-7f28dddf628c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:32.219974 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2f7e5824-273b-4443-b3d0-7f28dddf628c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:32.220413 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2f7e5824-273b-4443-b3d0-7f28dddf628c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:32.221109 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2f7e5824-273b-4443-b3d0-7f28dddf628c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:32.221547 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2f7e5824-273b-4443-b3d0-7f28dddf628c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:32.221970 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-2f7e5824-273b-4443-b3d0-7f28dddf628c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:32.357916 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-2f7e5824-273b-4443-b3d0-7f28dddf628c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:36:32.366211 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-2f7e5824-273b-4443-b3d0-7f28dddf628c tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c" status: 200 len: 1556 microversion: 2.1 time: 0.159616 Sep 21 12:36:32.366786 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 552/1119] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:36:32 2022] GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:36:32.388868 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-3a0c1348-2f1d-44ba-98ba-e2f224837e90 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:36:32.389400 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-3a0c1348-2f1d-44ba-98ba-e2f224837e90 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:36:32.395905 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3a0c1348-2f1d-44ba-98ba-e2f224837e90 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:32.396392 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3a0c1348-2f1d-44ba-98ba-e2f224837e90 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:32.396832 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3a0c1348-2f1d-44ba-98ba-e2f224837e90 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:32.397527 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3a0c1348-2f1d-44ba-98ba-e2f224837e90 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:32.397984 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3a0c1348-2f1d-44ba-98ba-e2f224837e90 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:32.398407 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3a0c1348-2f1d-44ba-98ba-e2f224837e90 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:32.473138 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-3a0c1348-2f1d-44ba-98ba-e2f224837e90 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088065 Sep 21 12:36:32.473770 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 568/1120] 10.222.0.71 () {58 vars in 1275 bytes} [Wed Sep 21 12:36:32 2022] GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 12:36:33.406797 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-c7af726a-c055-46cc-9a96-7e5cecd6b21d req-ffe18156-3531-4f15-ba94-6fe1e02ec853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c", "tag": "ba672dd3-4a5b-4ddf-bc85-e9f599fa0552"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:36:33.417579 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-c7af726a-c055-46cc-9a96-7e5cecd6b21d req-ffe18156-3531-4f15-ba94-6fe1e02ec853 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:36:33.418052 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-c7af726a-c055-46cc-9a96-7e5cecd6b21d req-ffe18156-3531-4f15-ba94-6fe1e02ec853 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:36:33.418481 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-c7af726a-c055-46cc-9a96-7e5cecd6b21d req-ffe18156-3531-4f15-ba94-6fe1e02ec853 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:36:33.430291 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-c7af726a-c055-46cc-9a96-7e5cecd6b21d req-ffe18156-3531-4f15-ba94-6fe1e02ec853 service nova] Creating event network-changed:ba672dd3-4a5b-4ddf-bc85-e9f599fa0552 for instance 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c on hv-cinder-85867 Sep 21 12:36:33.435656 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-c7af726a-c055-46cc-9a96-7e5cecd6b21d req-ffe18156-3531-4f15-ba94-6fe1e02ec853 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032434 Sep 21 12:36:33.436311 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 553/1121] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:37:28.930674 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:37:28.931428 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:37:28.935776 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-6db526cf-bde9-4d0a-bcaa-034516b55b3e tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1101464923", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1277426818", "security_groups": [{"name": "tempest-secgroup-smoke-2134419953"}], "block_device_mapping_v2": [{"uuid": "59cc38ad-0d7c-4c09-842f-47173bb0e41d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "df063f4b-39ab-4616-b570-b4e44f12336f"}]}} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:37:29.053135 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.network.neutron [None req-6db526cf-bde9-4d0a-bcaa-034516b55b3e tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] validate_networks() for [('df063f4b-39ab-4616-b570-b4e44f12336f', None, None, None, None, None)] {{(pid=120462) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 12:37:29.460307 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-6db526cf-bde9-4d0a-bcaa-034516b55b3e tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Flavor limits 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 12:37:29.460733 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-6db526cf-bde9-4d0a-bcaa-034516b55b3e tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Image limits 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 12:37:29.461214 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-6db526cf-bde9-4d0a-bcaa-034516b55b3e tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Flavor pref 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 12:37:29.461629 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-6db526cf-bde9-4d0a-bcaa-034516b55b3e tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Image pref 0:0:0 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 12:37:29.462043 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.virt.hardware [None req-6db526cf-bde9-4d0a-bcaa-034516b55b3e tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 12:37:29.470925 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6db526cf-bde9-4d0a-bcaa-034516b55b3e tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:29.471411 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6db526cf-bde9-4d0a-bcaa-034516b55b3e tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:29.471895 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6db526cf-bde9-4d0a-bcaa-034516b55b3e tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:29.472626 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6db526cf-bde9-4d0a-bcaa-034516b55b3e tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:29.473085 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6db526cf-bde9-4d0a-bcaa-034516b55b3e tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:29.473515 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6db526cf-bde9-4d0a-bcaa-034516b55b3e tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:29.491374 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-6db526cf-bde9-4d0a-bcaa-034516b55b3e tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Getting quotas for project 04bda0b59d3b4bfabf6f1b84fec0d6a6. Resources: {'instances', 'ram', 'cores'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 12:37:29.495363 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.quota [None req-6db526cf-bde9-4d0a-bcaa-034516b55b3e tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Getting quotas for user f84520fd4b434d99ad0dab1a1dd3b033 and project 04bda0b59d3b4bfabf6f1b84fec0d6a6. Resources: {'instances', 'ram', 'cores'} {{(pid=120462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 12:37:29.553049 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-6db526cf-bde9-4d0a-bcaa-034516b55b3e tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Going to run 1 instances... {{(pid=120462) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 12:37:29.555186 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-6db526cf-bde9-4d0a-bcaa-034516b55b3e tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 75bac536-33c8-4759-b20e-616b74cc9911] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='59cc38ad-0d7c-4c09-842f-47173bb0e41d',volume_size=None,volume_type=None)] {{(pid=120462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 12:37:29.686468 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-6db526cf-bde9-4d0a-bcaa-034516b55b3e tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.757207 Sep 21 12:37:29.687117 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 569/1122] 10.222.0.71 () {60 vars in 1147 bytes} [Wed Sep 21 12:37:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 21 12:37:29.696968 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:37:29.697790 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:37:29.701869 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-c7408fc8-d037-42da-abf0-1f330161ee8a tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:37:29.702579 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-c7408fc8-d037-42da-abf0-1f330161ee8a tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 75bac536-33c8-4759-b20e-616b74cc9911] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:37:29.763666 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-c7408fc8-d037-42da-abf0-1f330161ee8a tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:37:29.770584 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-c7408fc8-d037-42da-abf0-1f330161ee8a tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911" status: 200 len: 1095 microversion: 2.1 time: 0.075520 Sep 21 12:37:29.771223 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 554/1123] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:37:29 2022] GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911 => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:37:30.794054 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-595e0fd3-6f78-4948-b870-53f4079492be tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:37:30.794678 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-595e0fd3-6f78-4948-b870-53f4079492be tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 75bac536-33c8-4759-b20e-616b74cc9911] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:37:30.848734 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-595e0fd3-6f78-4948-b870-53f4079492be tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:37:30.856251 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-595e0fd3-6f78-4948-b870-53f4079492be tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911" status: 200 len: 1095 microversion: 2.1 time: 0.066494 Sep 21 12:37:30.856835 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 570/1124] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:37:30 2022] GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:37:31.878706 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-7cef3a5a-8745-45b5-a194-1d4c988371c6 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:37:31.879327 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-7cef3a5a-8745-45b5-a194-1d4c988371c6 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 75bac536-33c8-4759-b20e-616b74cc9911] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:37:31.931285 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-7cef3a5a-8745-45b5-a194-1d4c988371c6 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:37:31.938876 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-7cef3a5a-8745-45b5-a194-1d4c988371c6 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911" status: 200 len: 1095 microversion: 2.1 time: 0.064070 Sep 21 12:37:31.939443 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 555/1125] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:37:31 2022] GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911 => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:37:32.963110 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-239ec66c-238c-4ceb-bc70-def8798663dd tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:37:32.963717 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-239ec66c-238c-4ceb-bc70-def8798663dd tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 75bac536-33c8-4759-b20e-616b74cc9911] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:37:33.018467 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-239ec66c-238c-4ceb-bc70-def8798663dd tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:37:33.025230 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-239ec66c-238c-4ceb-bc70-def8798663dd tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911" status: 200 len: 1095 microversion: 2.1 time: 0.066891 Sep 21 12:37:33.025797 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 571/1126] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:37:32 2022] GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:37:34.048288 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-732f9d92-0f88-4024-a6c5-64e08ae08b19 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:37:34.049002 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-732f9d92-0f88-4024-a6c5-64e08ae08b19 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 75bac536-33c8-4759-b20e-616b74cc9911] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:37:34.056291 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-732f9d92-0f88-4024-a6c5-64e08ae08b19 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:34.056775 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-732f9d92-0f88-4024-a6c5-64e08ae08b19 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:34.057218 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-732f9d92-0f88-4024-a6c5-64e08ae08b19 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:34.057917 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-732f9d92-0f88-4024-a6c5-64e08ae08b19 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:34.058380 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-732f9d92-0f88-4024-a6c5-64e08ae08b19 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:34.058808 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-732f9d92-0f88-4024-a6c5-64e08ae08b19 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:34.120601 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-732f9d92-0f88-4024-a6c5-64e08ae08b19 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:37:34.128264 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-732f9d92-0f88-4024-a6c5-64e08ae08b19 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911" status: 200 len: 1145 microversion: 2.1 time: 0.083952 Sep 21 12:37:34.128839 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 556/1127] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:37:34 2022] GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:37:35.151513 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-470b33ff-4093-4dac-a2d3-a959908550e0 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:37:35.152292 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-470b33ff-4093-4dac-a2d3-a959908550e0 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 75bac536-33c8-4759-b20e-616b74cc9911] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:37:35.158700 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-470b33ff-4093-4dac-a2d3-a959908550e0 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:35.159467 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-470b33ff-4093-4dac-a2d3-a959908550e0 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:35.160032 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-470b33ff-4093-4dac-a2d3-a959908550e0 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:35.160979 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-470b33ff-4093-4dac-a2d3-a959908550e0 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:35.161688 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-470b33ff-4093-4dac-a2d3-a959908550e0 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:35.162167 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-470b33ff-4093-4dac-a2d3-a959908550e0 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:35.234521 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-470b33ff-4093-4dac-a2d3-a959908550e0 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:37:35.242177 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-470b33ff-4093-4dac-a2d3-a959908550e0 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911" status: 200 len: 1211 microversion: 2.1 time: 0.094632 Sep 21 12:37:35.242757 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 572/1128] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:37:35 2022] GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911 => generated 1211 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:37:36.266399 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-b10d2f63-be6a-4caf-a285-abb410aed118 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:37:36.266961 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-b10d2f63-be6a-4caf-a285-abb410aed118 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 75bac536-33c8-4759-b20e-616b74cc9911] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:37:36.273987 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b10d2f63-be6a-4caf-a285-abb410aed118 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:36.274483 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b10d2f63-be6a-4caf-a285-abb410aed118 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:36.274929 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b10d2f63-be6a-4caf-a285-abb410aed118 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:36.275638 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b10d2f63-be6a-4caf-a285-abb410aed118 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:36.276154 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b10d2f63-be6a-4caf-a285-abb410aed118 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:36.276593 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b10d2f63-be6a-4caf-a285-abb410aed118 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:36.413362 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-b10d2f63-be6a-4caf-a285-abb410aed118 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:37:36.422177 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-b10d2f63-be6a-4caf-a285-abb410aed118 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911" status: 200 len: 1267 microversion: 2.1 time: 0.159676 Sep 21 12:37:36.423021 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 557/1129] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:37:36 2022] GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:37:36.711619 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-077fef8b-2b2e-45ff-ab58-4f14f68a2a12 req-4035a72e-6cc9-4e30-bd9c-f023355bfc57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75bac536-33c8-4759-b20e-616b74cc9911", "tag": "b59a24c4-8b22-46a9-9862-f49dd8712720"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:37:36.724360 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-077fef8b-2b2e-45ff-ab58-4f14f68a2a12 req-4035a72e-6cc9-4e30-bd9c-f023355bfc57 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:36.724921 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-077fef8b-2b2e-45ff-ab58-4f14f68a2a12 req-4035a72e-6cc9-4e30-bd9c-f023355bfc57 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:36.725289 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-077fef8b-2b2e-45ff-ab58-4f14f68a2a12 req-4035a72e-6cc9-4e30-bd9c-f023355bfc57 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:36.736591 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-077fef8b-2b2e-45ff-ab58-4f14f68a2a12 req-4035a72e-6cc9-4e30-bd9c-f023355bfc57 service nova] Creating event network-changed:b59a24c4-8b22-46a9-9862-f49dd8712720 for instance 75bac536-33c8-4759-b20e-616b74cc9911 on hv-cinder-85867 Sep 21 12:37:36.741813 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-077fef8b-2b2e-45ff-ab58-4f14f68a2a12 req-4035a72e-6cc9-4e30-bd9c-f023355bfc57 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102822 Sep 21 12:37:36.742415 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 573/1130] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:37:37.446025 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-e1e06db3-ecca-44d0-ae8f-6966638c1d3a tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:37:37.446678 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-e1e06db3-ecca-44d0-ae8f-6966638c1d3a tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 75bac536-33c8-4759-b20e-616b74cc9911] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:37:37.453222 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e1e06db3-ecca-44d0-ae8f-6966638c1d3a tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:37.453715 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e1e06db3-ecca-44d0-ae8f-6966638c1d3a tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:37.454168 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e1e06db3-ecca-44d0-ae8f-6966638c1d3a tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:37.454868 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e1e06db3-ecca-44d0-ae8f-6966638c1d3a tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:37.455331 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e1e06db3-ecca-44d0-ae8f-6966638c1d3a tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:37.455782 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e1e06db3-ecca-44d0-ae8f-6966638c1d3a tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:37.585307 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-e1e06db3-ecca-44d0-ae8f-6966638c1d3a tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:37:37.593519 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-e1e06db3-ecca-44d0-ae8f-6966638c1d3a tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911" status: 200 len: 1267 microversion: 2.1 time: 0.151415 Sep 21 12:37:37.594112 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 558/1131] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:37:37 2022] GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:37:38.618121 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-da23acce-762e-4bfc-b8f4-ffde11851059 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:37:38.618748 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-da23acce-762e-4bfc-b8f4-ffde11851059 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 75bac536-33c8-4759-b20e-616b74cc9911] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:37:38.625156 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-da23acce-762e-4bfc-b8f4-ffde11851059 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:38.625727 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-da23acce-762e-4bfc-b8f4-ffde11851059 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:38.626085 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-da23acce-762e-4bfc-b8f4-ffde11851059 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:38.626809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-da23acce-762e-4bfc-b8f4-ffde11851059 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:38.627270 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-da23acce-762e-4bfc-b8f4-ffde11851059 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:38.627701 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-da23acce-762e-4bfc-b8f4-ffde11851059 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:38.761465 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-da23acce-762e-4bfc-b8f4-ffde11851059 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:37:38.769311 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-da23acce-762e-4bfc-b8f4-ffde11851059 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911" status: 200 len: 1267 microversion: 2.1 time: 0.156086 Sep 21 12:37:38.769878 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 574/1132] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:37:38 2022] GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:37:39.792306 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-d33bdafd-a6b4-4ae6-a4ee-459923a35913 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:37:39.792944 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-d33bdafd-a6b4-4ae6-a4ee-459923a35913 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 75bac536-33c8-4759-b20e-616b74cc9911] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:37:39.799389 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d33bdafd-a6b4-4ae6-a4ee-459923a35913 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:39.799911 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d33bdafd-a6b4-4ae6-a4ee-459923a35913 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:39.800358 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d33bdafd-a6b4-4ae6-a4ee-459923a35913 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:39.801053 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d33bdafd-a6b4-4ae6-a4ee-459923a35913 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:39.801515 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d33bdafd-a6b4-4ae6-a4ee-459923a35913 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:39.801961 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d33bdafd-a6b4-4ae6-a4ee-459923a35913 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:39.934678 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-d33bdafd-a6b4-4ae6-a4ee-459923a35913 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:37:39.942380 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-d33bdafd-a6b4-4ae6-a4ee-459923a35913 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911" status: 200 len: 1267 microversion: 2.1 time: 0.153964 Sep 21 12:37:39.943558 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 559/1133] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:37:39 2022] GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:37:40.965824 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-56d6104c-40e8-444d-b5d5-dd1ad72afb61 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:37:40.966448 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-56d6104c-40e8-444d-b5d5-dd1ad72afb61 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 75bac536-33c8-4759-b20e-616b74cc9911] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:37:40.968353 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell0:SELECT=2 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:37:40.974518 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-56d6104c-40e8-444d-b5d5-dd1ad72afb61 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:40.974990 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-56d6104c-40e8-444d-b5d5-dd1ad72afb61 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:40.975420 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-56d6104c-40e8-444d-b5d5-dd1ad72afb61 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:40.976136 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-56d6104c-40e8-444d-b5d5-dd1ad72afb61 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:40.976583 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-56d6104c-40e8-444d-b5d5-dd1ad72afb61 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:40.977003 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-56d6104c-40e8-444d-b5d5-dd1ad72afb61 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:41.120151 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-56d6104c-40e8-444d-b5d5-dd1ad72afb61 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:37:41.127800 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-56d6104c-40e8-444d-b5d5-dd1ad72afb61 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911" status: 200 len: 1267 microversion: 2.1 time: 0.166083 Sep 21 12:37:41.128372 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 575/1134] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:37:40 2022] GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:37:42.150913 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-c858fc6a-393d-4daa-9453-9f75c6d689fe tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:37:42.151522 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-c858fc6a-393d-4daa-9453-9f75c6d689fe tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 75bac536-33c8-4759-b20e-616b74cc9911] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:37:42.153821 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell0:SELECT=4 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:37:42.159470 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c858fc6a-393d-4daa-9453-9f75c6d689fe tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:42.159986 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c858fc6a-393d-4daa-9453-9f75c6d689fe tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:42.160423 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c858fc6a-393d-4daa-9453-9f75c6d689fe tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:42.161109 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c858fc6a-393d-4daa-9453-9f75c6d689fe tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:42.162208 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c858fc6a-393d-4daa-9453-9f75c6d689fe tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:42.162659 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c858fc6a-393d-4daa-9453-9f75c6d689fe tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:42.296306 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-c858fc6a-393d-4daa-9453-9f75c6d689fe tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:37:42.303858 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-c858fc6a-393d-4daa-9453-9f75c6d689fe tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911" status: 200 len: 1267 microversion: 2.1 time: 0.156849 Sep 21 12:37:42.304436 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 560/1135] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:37:42 2022] GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:37:43.326544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-e74f6b10-7f71-4a58-8668-2af7c70ddfbe tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:37:43.327159 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-e74f6b10-7f71-4a58-8668-2af7c70ddfbe tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 75bac536-33c8-4759-b20e-616b74cc9911] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:37:43.329425 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell0:SELECT=10 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:37:43.335038 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e74f6b10-7f71-4a58-8668-2af7c70ddfbe tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:43.335514 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e74f6b10-7f71-4a58-8668-2af7c70ddfbe tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:43.335981 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e74f6b10-7f71-4a58-8668-2af7c70ddfbe tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:43.336670 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e74f6b10-7f71-4a58-8668-2af7c70ddfbe tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:43.337120 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e74f6b10-7f71-4a58-8668-2af7c70ddfbe tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:43.337539 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-e74f6b10-7f71-4a58-8668-2af7c70ddfbe tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:43.469983 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-e74f6b10-7f71-4a58-8668-2af7c70ddfbe tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:37:43.478266 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-e74f6b10-7f71-4a58-8668-2af7c70ddfbe tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911" status: 200 len: 1267 microversion: 2.1 time: 0.155595 Sep 21 12:37:43.478838 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 576/1136] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:37:43 2022] GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:37:44.501496 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-eac8c880-a625-426d-a663-6a02c3e5709f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:37:44.502064 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-eac8c880-a625-426d-a663-6a02c3e5709f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 75bac536-33c8-4759-b20e-616b74cc9911] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:37:44.508495 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eac8c880-a625-426d-a663-6a02c3e5709f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:44.508980 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eac8c880-a625-426d-a663-6a02c3e5709f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:44.509418 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eac8c880-a625-426d-a663-6a02c3e5709f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:44.510117 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eac8c880-a625-426d-a663-6a02c3e5709f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:44.510574 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eac8c880-a625-426d-a663-6a02c3e5709f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:44.511004 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eac8c880-a625-426d-a663-6a02c3e5709f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:44.645044 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-eac8c880-a625-426d-a663-6a02c3e5709f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:37:44.653254 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-eac8c880-a625-426d-a663-6a02c3e5709f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911" status: 200 len: 1267 microversion: 2.1 time: 0.155723 Sep 21 12:37:44.653833 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 561/1137] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:37:44 2022] GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:37:45.676771 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-9cf38697-2b80-48f9-a5a1-3602fd4f20c2 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:37:45.678308 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-9cf38697-2b80-48f9-a5a1-3602fd4f20c2 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 75bac536-33c8-4759-b20e-616b74cc9911] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:37:45.685364 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9cf38697-2b80-48f9-a5a1-3602fd4f20c2 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:45.685859 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9cf38697-2b80-48f9-a5a1-3602fd4f20c2 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:45.686299 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9cf38697-2b80-48f9-a5a1-3602fd4f20c2 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:45.687005 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9cf38697-2b80-48f9-a5a1-3602fd4f20c2 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:45.687465 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9cf38697-2b80-48f9-a5a1-3602fd4f20c2 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:45.687946 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-9cf38697-2b80-48f9-a5a1-3602fd4f20c2 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:45.820384 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-9cf38697-2b80-48f9-a5a1-3602fd4f20c2 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:37:45.828551 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-9cf38697-2b80-48f9-a5a1-3602fd4f20c2 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911" status: 200 len: 1267 microversion: 2.1 time: 0.155772 Sep 21 12:37:45.829261 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 577/1138] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:37:45 2022] GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:37:46.478250 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-ff6f7192-a65d-4092-a043-a87c1670e4e2 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:37:46.478906 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-ff6f7192-a65d-4092-a043-a87c1670e4e2 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:37:46.480838 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 21 12:37:46.480996 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Wed Sep 21 12:37:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c/ips (ip 10.222.0.71) !!! Sep 21 12:37:46.488050 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ff6f7192-a65d-4092-a043-a87c1670e4e2 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:46.488549 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ff6f7192-a65d-4092-a043-a87c1670e4e2 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:46.488995 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ff6f7192-a65d-4092-a043-a87c1670e4e2 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:46.489717 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ff6f7192-a65d-4092-a043-a87c1670e4e2 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:46.490182 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ff6f7192-a65d-4092-a043-a87c1670e4e2 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:46.490618 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ff6f7192-a65d-4092-a043-a87c1670e4e2 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:46.516404 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-ff6f7192-a65d-4092-a043-a87c1670e4e2 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c/ips" status: 200 len: 149 microversion: 2.1 time: 0.042088 Sep 21 12:37:46.517001 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 562/1139] 10.222.0.71 () {58 vars in 1248 bytes} [Wed Sep 21 12:37:46 2022] GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:37:46.851916 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-0384f3c5-3559-4bc7-96fd-6971dd59ffc8 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:37:46.852562 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-0384f3c5-3559-4bc7-96fd-6971dd59ffc8 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 75bac536-33c8-4759-b20e-616b74cc9911] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:37:46.859396 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0384f3c5-3559-4bc7-96fd-6971dd59ffc8 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:46.859938 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0384f3c5-3559-4bc7-96fd-6971dd59ffc8 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:46.860370 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0384f3c5-3559-4bc7-96fd-6971dd59ffc8 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:46.861083 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0384f3c5-3559-4bc7-96fd-6971dd59ffc8 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:46.861531 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0384f3c5-3559-4bc7-96fd-6971dd59ffc8 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:46.861952 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0384f3c5-3559-4bc7-96fd-6971dd59ffc8 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:47.006945 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-0384f3c5-3559-4bc7-96fd-6971dd59ffc8 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:37:47.014688 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-0384f3c5-3559-4bc7-96fd-6971dd59ffc8 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911" status: 200 len: 1267 microversion: 2.1 time: 0.166831 Sep 21 12:37:47.015274 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 578/1140] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:37:46 2022] GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:37:47.862779 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-d9a763c0-2770-44b7-bb31-cd473e68aa19 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c19e720-b47d-4b3f-acd6-28fe5e9bc93f"}} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:37:47.865312 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-d9a763c0-2770-44b7-bb31-cd473e68aa19 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:37:47.872681 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d9a763c0-2770-44b7-bb31-cd473e68aa19 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:47.873462 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d9a763c0-2770-44b7-bb31-cd473e68aa19 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:47.874083 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d9a763c0-2770-44b7-bb31-cd473e68aa19 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:47.875209 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d9a763c0-2770-44b7-bb31-cd473e68aa19 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:47.876309 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d9a763c0-2770-44b7-bb31-cd473e68aa19 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:47.877127 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d9a763c0-2770-44b7-bb31-cd473e68aa19 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:47.914034 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-d0fa0259-34ba-4e45-ad4d-d8dedf1cecb1 req-a765a194-479e-4527-8825-ddba85057312 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75bac536-33c8-4759-b20e-616b74cc9911", "name": "network-vif-plugged", "status": "completed", "tag": "b59a24c4-8b22-46a9-9862-f49dd8712720"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:37:47.923406 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-d0fa0259-34ba-4e45-ad4d-d8dedf1cecb1 req-a765a194-479e-4527-8825-ddba85057312 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:47.923927 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-d0fa0259-34ba-4e45-ad4d-d8dedf1cecb1 req-a765a194-479e-4527-8825-ddba85057312 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:47.924363 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-d0fa0259-34ba-4e45-ad4d-d8dedf1cecb1 req-a765a194-479e-4527-8825-ddba85057312 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:47.936482 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-d0fa0259-34ba-4e45-ad4d-d8dedf1cecb1 req-a765a194-479e-4527-8825-ddba85057312 service nova] Creating event network-vif-plugged:b59a24c4-8b22-46a9-9862-f49dd8712720 for instance 75bac536-33c8-4759-b20e-616b74cc9911 on hv-cinder-85867 Sep 21 12:37:47.941582 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-d0fa0259-34ba-4e45-ad4d-d8dedf1cecb1 req-a765a194-479e-4527-8825-ddba85057312 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100851 Sep 21 12:37:47.942176 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 563/1141] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:37:48.038230 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-50e5b7c7-34bc-4d7d-90aa-44aa4def46be tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:37:48.038971 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-50e5b7c7-34bc-4d7d-90aa-44aa4def46be tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 75bac536-33c8-4759-b20e-616b74cc9911] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:37:48.045718 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-50e5b7c7-34bc-4d7d-90aa-44aa4def46be tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:48.046252 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-50e5b7c7-34bc-4d7d-90aa-44aa4def46be tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:48.046679 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-50e5b7c7-34bc-4d7d-90aa-44aa4def46be tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:48.047429 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-50e5b7c7-34bc-4d7d-90aa-44aa4def46be tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:48.048076 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-50e5b7c7-34bc-4d7d-90aa-44aa4def46be tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:48.048512 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-50e5b7c7-34bc-4d7d-90aa-44aa4def46be tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:48.200755 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-50e5b7c7-34bc-4d7d-90aa-44aa4def46be tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:37:48.209697 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-50e5b7c7-34bc-4d7d-90aa-44aa4def46be tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911" status: 200 len: 1267 microversion: 2.1 time: 0.175876 Sep 21 12:37:48.210446 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 564/1142] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:37:48 2022] GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:37:48.265624 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-d9a763c0-2770-44b7-bb31-cd473e68aa19 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "POST /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.407170 Sep 21 12:37:48.266330 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 579/1143] 10.222.0.71 () {60 vars in 1323 bytes} [Wed Sep 21 12:37:47 2022] POST /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c/os-volume_attachments => generated 194 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 12:37:49.233473 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-7a0dbd5e-61f9-4230-a4dd-2f3da53fe19f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:37:49.234024 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-7a0dbd5e-61f9-4230-a4dd-2f3da53fe19f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 75bac536-33c8-4759-b20e-616b74cc9911] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:37:49.240908 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7a0dbd5e-61f9-4230-a4dd-2f3da53fe19f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:49.241443 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7a0dbd5e-61f9-4230-a4dd-2f3da53fe19f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:49.241877 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7a0dbd5e-61f9-4230-a4dd-2f3da53fe19f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:49.242629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7a0dbd5e-61f9-4230-a4dd-2f3da53fe19f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:49.243078 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7a0dbd5e-61f9-4230-a4dd-2f3da53fe19f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:49.243499 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-7a0dbd5e-61f9-4230-a4dd-2f3da53fe19f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:49.376716 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-7a0dbd5e-61f9-4230-a4dd-2f3da53fe19f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:37:49.386425 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-7a0dbd5e-61f9-4230-a4dd-2f3da53fe19f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911" status: 200 len: 1267 microversion: 2.1 time: 0.156829 Sep 21 12:37:49.387008 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 565/1144] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:37:49 2022] GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:37:50.410059 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-71917437-6e2f-4a76-af75-fb2578344e0d tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:37:50.410848 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-71917437-6e2f-4a76-af75-fb2578344e0d tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 75bac536-33c8-4759-b20e-616b74cc9911] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:37:50.417094 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-71917437-6e2f-4a76-af75-fb2578344e0d tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:50.417578 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-71917437-6e2f-4a76-af75-fb2578344e0d tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:50.418013 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-71917437-6e2f-4a76-af75-fb2578344e0d tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:50.418708 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-71917437-6e2f-4a76-af75-fb2578344e0d tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:50.419218 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-71917437-6e2f-4a76-af75-fb2578344e0d tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:50.419601 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-71917437-6e2f-4a76-af75-fb2578344e0d tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:50.555825 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-71917437-6e2f-4a76-af75-fb2578344e0d tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:37:50.563656 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-71917437-6e2f-4a76-af75-fb2578344e0d tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911" status: 200 len: 1454 microversion: 2.1 time: 0.158398 Sep 21 12:37:50.564282 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 580/1145] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:37:50 2022] GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911 => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:37:50.590790 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-53431c98-4379-496d-b420-5233224f5d5e tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:37:50.591417 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-53431c98-4379-496d-b420-5233224f5d5e tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 75bac536-33c8-4759-b20e-616b74cc9911] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:37:50.598041 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-53431c98-4379-496d-b420-5233224f5d5e tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:50.598706 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-53431c98-4379-496d-b420-5233224f5d5e tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:50.599006 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-53431c98-4379-496d-b420-5233224f5d5e tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:50.599703 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-53431c98-4379-496d-b420-5233224f5d5e tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:50.600197 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-53431c98-4379-496d-b420-5233224f5d5e tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:50.600629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-53431c98-4379-496d-b420-5233224f5d5e tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:50.733939 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-53431c98-4379-496d-b420-5233224f5d5e tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:37:50.742262 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-53431c98-4379-496d-b420-5233224f5d5e tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911" status: 200 len: 1454 microversion: 2.1 time: 0.155608 Sep 21 12:37:50.742843 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 566/1146] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:37:50 2022] GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911 => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:37:52.415790 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-298c145c-25e1-4b52-9a42-e5aadf060bd4 req-e42f5728-9bdf-4db5-9734-a066718205ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75bac536-33c8-4759-b20e-616b74cc9911", "tag": "b59a24c4-8b22-46a9-9862-f49dd8712720"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:37:52.425108 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-298c145c-25e1-4b52-9a42-e5aadf060bd4 req-e42f5728-9bdf-4db5-9734-a066718205ce service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:52.425584 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-298c145c-25e1-4b52-9a42-e5aadf060bd4 req-e42f5728-9bdf-4db5-9734-a066718205ce service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:52.426012 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-298c145c-25e1-4b52-9a42-e5aadf060bd4 req-e42f5728-9bdf-4db5-9734-a066718205ce service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:52.437847 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-298c145c-25e1-4b52-9a42-e5aadf060bd4 req-e42f5728-9bdf-4db5-9734-a066718205ce service nova] Creating event network-changed:b59a24c4-8b22-46a9-9862-f49dd8712720 for instance 75bac536-33c8-4759-b20e-616b74cc9911 on hv-cinder-85867 Sep 21 12:37:52.442773 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-298c145c-25e1-4b52-9a42-e5aadf060bd4 req-e42f5728-9bdf-4db5-9734-a066718205ce service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031607 Sep 21 12:37:52.443371 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 581/1147] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:37:56.986373 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-5a143579-b1a6-44d7-9cbf-a91009ef6039 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:37:56.986927 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-5a143579-b1a6-44d7-9cbf-a91009ef6039 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:37:56.993553 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5a143579-b1a6-44d7-9cbf-a91009ef6039 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:56.994043 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5a143579-b1a6-44d7-9cbf-a91009ef6039 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:56.994490 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5a143579-b1a6-44d7-9cbf-a91009ef6039 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:56.995188 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5a143579-b1a6-44d7-9cbf-a91009ef6039 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:56.995652 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5a143579-b1a6-44d7-9cbf-a91009ef6039 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:56.996116 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-5a143579-b1a6-44d7-9cbf-a91009ef6039 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:57.077581 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.objects.instance [None req-5a143579-b1a6-44d7-9cbf-a91009ef6039 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lazy-loading 'services' on Instance uuid 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c {{(pid=120463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 12:37:57.153141 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-5a143579-b1a6-44d7-9cbf-a91009ef6039 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "DELETE /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c/os-volume_attachments/1c19e720-b47d-4b3f-acd6-28fe5e9bc93f" status: 202 len: 0 microversion: 2.1 time: 0.170583 Sep 21 12:37:57.153729 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 567/1148] 10.222.0.71 () {58 vars in 1416 bytes} [Wed Sep 21 12:37:56 2022] DELETE /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c/os-volume_attachments/1c19e720-b47d-4b3f-acd6-28fe5e9bc93f => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 12:37:57.163591 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-96753fb2-0ef1-4215-9067-d3c4a023905d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:37:57.165998 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-96753fb2-0ef1-4215-9067-d3c4a023905d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:37:57.172570 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-96753fb2-0ef1-4215-9067-d3c4a023905d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:57.173061 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-96753fb2-0ef1-4215-9067-d3c4a023905d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:57.173499 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-96753fb2-0ef1-4215-9067-d3c4a023905d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:57.174242 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-96753fb2-0ef1-4215-9067-d3c4a023905d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:57.174697 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-96753fb2-0ef1-4215-9067-d3c4a023905d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:57.175123 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-96753fb2-0ef1-4215-9067-d3c4a023905d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:57.207995 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-96753fb2-0ef1-4215-9067-d3c4a023905d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049540 Sep 21 12:37:57.208563 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 582/1149] 10.222.0.71 () {58 vars in 1302 bytes} [Wed Sep 21 12:37:57 2022] GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:37:58.222105 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-ebd1655f-0a4f-4412-8f75-56fd9fc935f5 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:37:58.224632 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-ebd1655f-0a4f-4412-8f75-56fd9fc935f5 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:37:58.230866 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ebd1655f-0a4f-4412-8f75-56fd9fc935f5 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:58.231354 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ebd1655f-0a4f-4412-8f75-56fd9fc935f5 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:58.231832 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ebd1655f-0a4f-4412-8f75-56fd9fc935f5 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:58.232531 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ebd1655f-0a4f-4412-8f75-56fd9fc935f5 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:58.232992 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ebd1655f-0a4f-4412-8f75-56fd9fc935f5 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:58.233423 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ebd1655f-0a4f-4412-8f75-56fd9fc935f5 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:58.264081 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-ebd1655f-0a4f-4412-8f75-56fd9fc935f5 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046797 Sep 21 12:37:58.264651 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 568/1150] 10.222.0.71 () {58 vars in 1302 bytes} [Wed Sep 21 12:37:58 2022] GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 21 12:37:58.329193 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-59741747-c312-4640-bdcd-4017c321f14d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:37:58.329730 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-59741747-c312-4640-bdcd-4017c321f14d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:37:58.336687 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-59741747-c312-4640-bdcd-4017c321f14d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:58.337161 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-59741747-c312-4640-bdcd-4017c321f14d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:58.337594 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-59741747-c312-4640-bdcd-4017c321f14d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:58.338529 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-59741747-c312-4640-bdcd-4017c321f14d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:58.338976 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-59741747-c312-4640-bdcd-4017c321f14d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:58.339397 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-59741747-c312-4640-bdcd-4017c321f14d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:58.364706 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-59741747-c312-4640-bdcd-4017c321f14d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c] Going to try to terminate instance {{(pid=120462) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 12:37:58.441442 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-59741747-c312-4640-bdcd-4017c321f14d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "DELETE /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c" status: 204 len: 0 microversion: 2.1 time: 0.115851 Sep 21 12:37:58.442023 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 583/1151] 10.222.0.71 () {58 vars in 1239 bytes} [Wed Sep 21 12:37:58 2022] DELETE /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 21 12:37:58.451090 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-b1d84421-217a-423b-bf10-d14e6390962b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:37:58.451709 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-b1d84421-217a-423b-bf10-d14e6390962b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:37:58.458812 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b1d84421-217a-423b-bf10-d14e6390962b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:58.459304 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b1d84421-217a-423b-bf10-d14e6390962b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:58.459748 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b1d84421-217a-423b-bf10-d14e6390962b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:58.460533 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b1d84421-217a-423b-bf10-d14e6390962b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:58.460997 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b1d84421-217a-423b-bf10-d14e6390962b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:58.461428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b1d84421-217a-423b-bf10-d14e6390962b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:58.591647 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-b1d84421-217a-423b-bf10-d14e6390962b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:37:58.599690 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-b1d84421-217a-423b-bf10-d14e6390962b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c" status: 200 len: 1681 microversion: 2.1 time: 0.152439 Sep 21 12:37:58.600296 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 569/1152] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:37:58 2022] GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:37:59.624137 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-dbbf848f-c3c3-4939-92de-b272c2c64585 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:37:59.624839 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-dbbf848f-c3c3-4939-92de-b272c2c64585 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:37:59.627200 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:37:59.632821 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dbbf848f-c3c3-4939-92de-b272c2c64585 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:59.633307 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dbbf848f-c3c3-4939-92de-b272c2c64585 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:59.633867 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dbbf848f-c3c3-4939-92de-b272c2c64585 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:59.634580 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dbbf848f-c3c3-4939-92de-b272c2c64585 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:37:59.635038 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dbbf848f-c3c3-4939-92de-b272c2c64585 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:37:59.635471 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-dbbf848f-c3c3-4939-92de-b272c2c64585 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:37:59.639002 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:37:59.773273 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-dbbf848f-c3c3-4939-92de-b272c2c64585 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:37:59.780983 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-dbbf848f-c3c3-4939-92de-b272c2c64585 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c" status: 200 len: 1681 microversion: 2.1 time: 0.161173 Sep 21 12:37:59.781552 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 584/1153] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:37:59 2022] GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:38:00.804019 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-156a7ee2-9628-4bf9-af41-01e2408eef7b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:38:00.804703 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-156a7ee2-9628-4bf9-af41-01e2408eef7b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:38:00.807173 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=37 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:38:00.812237 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-156a7ee2-9628-4bf9-af41-01e2408eef7b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:38:00.812722 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-156a7ee2-9628-4bf9-af41-01e2408eef7b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:38:00.813157 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-156a7ee2-9628-4bf9-af41-01e2408eef7b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:38:00.813857 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-156a7ee2-9628-4bf9-af41-01e2408eef7b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:38:00.814307 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-156a7ee2-9628-4bf9-af41-01e2408eef7b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:38:00.814729 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-156a7ee2-9628-4bf9-af41-01e2408eef7b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:38:00.819361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=1 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:38:00.961012 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-156a7ee2-9628-4bf9-af41-01e2408eef7b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d4dfe489634f3c9346b0ab86408e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7f2ef25e054b619068baf878bead18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:38:00.978194 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-156a7ee2-9628-4bf9-af41-01e2408eef7b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c" status: 200 len: 1681 microversion: 2.1 time: 0.177617 Sep 21 12:38:00.978802 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 570/1154] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:38:00 2022] GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:38:01.225567 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-7b071faa-b9cd-476c-aa84-9dccb5e7182b req-2efe5889-f5fc-463e-a2de-563c77adb62c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c", "name": "network-vif-deleted", "tag": "ba672dd3-4a5b-4ddf-bc85-e9f599fa0552"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:38:01.235877 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-7b071faa-b9cd-476c-aa84-9dccb5e7182b req-2efe5889-f5fc-463e-a2de-563c77adb62c service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:38:01.236365 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-7b071faa-b9cd-476c-aa84-9dccb5e7182b req-2efe5889-f5fc-463e-a2de-563c77adb62c service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:38:01.236797 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-7b071faa-b9cd-476c-aa84-9dccb5e7182b req-2efe5889-f5fc-463e-a2de-563c77adb62c service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:38:01.251085 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-7b071faa-b9cd-476c-aa84-9dccb5e7182b req-2efe5889-f5fc-463e-a2de-563c77adb62c service nova] Creating event network-vif-deleted:ba672dd3-4a5b-4ddf-bc85-e9f599fa0552 for instance 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c on hv-cinder-85867 Sep 21 12:38:01.257145 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-7b071faa-b9cd-476c-aa84-9dccb5e7182b req-2efe5889-f5fc-463e-a2de-563c77adb62c service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035409 Sep 21 12:38:01.257757 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 585/1155] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:38:02.002191 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-ae7f511d-f16b-4e56-84d1-b3269a6f5b8f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:38:02.003549 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-ae7f511d-f16b-4e56-84d1-b3269a6f5b8f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:38:02.011098 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ae7f511d-f16b-4e56-84d1-b3269a6f5b8f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:38:02.011988 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ae7f511d-f16b-4e56-84d1-b3269a6f5b8f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:38:02.011988 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ae7f511d-f16b-4e56-84d1-b3269a6f5b8f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:38:02.012553 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ae7f511d-f16b-4e56-84d1-b3269a6f5b8f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:38:02.013011 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ae7f511d-f16b-4e56-84d1-b3269a6f5b8f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:38:02.013441 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ae7f511d-f16b-4e56-84d1-b3269a6f5b8f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:38:02.027925 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.wsgi [None req-ae7f511d-f16b-4e56-84d1-b3269a6f5b8f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] HTTP exception thrown: Instance 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c could not be found. Sep 21 12:38:02.029945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-ae7f511d-f16b-4e56-84d1-b3269a6f5b8f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Request method failure captured: Sep 21 12:38:02.029945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: request: GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c HTTP/1.1 Sep 21 12:38:02.029945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept: application/json Sep 21 12:38:02.029945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept-Encoding: identity Sep 21 12:38:02.029945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Connection: close Sep 21 12:38:02.029945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Length: 0 Sep 21 12:38:02.029945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Type: application/json Sep 21 12:38:02.029945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Host: 10.222.0.71 Sep 21 12:38:02.029945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Openstack-System-Scope: None Sep 21 12:38:02.029945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: User-Agent: python-urllib3/1.26.12 Sep 21 12:38:02.029945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Auth-Token: gAAAAABjKwQbqCTIemwdFFQg4iXhIhsYIA26P2YauPIL4u-NnB6IhqS_YvqFD-8J1npMFI_nNFzmN0CnWmYrRfR3q-kNeYlkoz_mojSbL04ZdZGfD7Us18CZ0XAmBUWJA2QleQStXzvqL0eNZfiCAHfkcyv8CGZMSMlFp6BBl5cDKWdeHuqik0o Sep 21 12:38:02.029945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Id: None Sep 21 12:38:02.029945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Name: None Sep 21 12:38:02.029945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Identity-Status: Confirmed Sep 21 12:38:02.029945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Is-Admin-Project: True Sep 21 12:38:02.029945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Id: default Sep 21 12:38:02.029945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Name: Default Sep 21 12:38:02.029945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Id: bd7f2ef25e054b619068baf878bead18 Sep 21 12:38:02.029945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Name: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:38:02.029945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Role: reader,member Sep 21 12:38:02.029945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Roles: reader,member Sep 21 12:38:02.031746 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/bd7f2ef25e054b619068baf878bead18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/bd7f2ef25e054b619068baf878bead18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_bd7f2ef25e054b619068baf878bead18", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/bd7f2ef25e054b619068baf878bead18"}]}] Sep 21 12:38:02.031746 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:38:02.031746 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Id: bd7f2ef25e054b619068baf878bead18 Sep 21 12:38:02.031746 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:38:02.031746 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User: tempest-AttachVolumeNegativeTest-367231197-project Sep 21 12:38:02.031746 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Id: default Sep 21 12:38:02.031746 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Name: Default Sep 21 12:38:02.031746 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Id: 90d4dfe489634f3c9346b0ab86408e3b Sep 21 12:38:02.031746 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Name: tempest-AttachVolumeNegativeTest-367231197-project Sep 21 12:38:02.031746 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: method: > Sep 21 12:38:02.031746 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: exception: Instance 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c could not be found. Sep 21 12:38:02.031746 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: action_args: {'id': '22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c'} Sep 21 12:38:02.032798 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:38:02.032798 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:02.032798 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:38:02.032798 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:38:02.032798 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:38:02.032798 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:38:02.032798 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:38:02.032798 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:38:02.032798 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:38:02.032798 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:38:02.032798 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c could not be found. Sep 21 12:38:02.032798 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:02.032798 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:38:02.032798 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:02.032798 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:02.032798 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:38:02.032798 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:38:02.032798 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:38:02.032798 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:38:02.032798 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:38:02.035081 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:38:02.035081 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 12:38:02.035081 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 12:38:02.035081 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:38:02.035081 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:38:02.035081 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:38:02.035081 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:38:02.035081 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c could not be found. Sep 21 12:38:02.035081 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:02.035081 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:38:02.035081 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:02.035081 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:02.035081 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:38:02.035081 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:38:02.035081 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:38:02.035081 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:38:02.035081 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c could not be found. Sep 21 12:38:02.035081 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:02.038029 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-ae7f511d-f16b-4e56-84d1-b3269a6f5b8f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Returning 404 to user: Instance 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c could not be found. {{(pid=120463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:38:02.038029 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-ae7f511d-f16b-4e56-84d1-b3269a6f5b8f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c" status: 404 len: 111 microversion: 2.1 time: 0.033759 Sep 21 12:38:02.038029 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 571/1156] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:38:01 2022] GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 21 12:38:02.044687 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-1c48fe3c-4d9c-4351-b31b-2685bd0277c4 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '.version_select at 0x7fe4cc65af70>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:38:02.066033 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-1c48fe3c-4d9c-4351-b31b-2685bd0277c4 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1365059727" status: 202 len: 0 microversion: 2.1 time: 0.026160 Sep 21 12:38:02.066629 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 586/1157] 10.222.0.71 () {58 vars in 1221 bytes} [Wed Sep 21 12:38:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1365059727 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 12:38:03.845014 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-4b80502d-2448-4ebc-9b56-7b8e5d9dc92e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:38:03.845535 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-4b80502d-2448-4ebc-9b56-7b8e5d9dc92e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:38:03.852174 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4b80502d-2448-4ebc-9b56-7b8e5d9dc92e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:38:03.852659 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4b80502d-2448-4ebc-9b56-7b8e5d9dc92e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:38:03.853099 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4b80502d-2448-4ebc-9b56-7b8e5d9dc92e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:38:03.853801 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4b80502d-2448-4ebc-9b56-7b8e5d9dc92e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:38:03.854254 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4b80502d-2448-4ebc-9b56-7b8e5d9dc92e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:38:03.854682 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-4b80502d-2448-4ebc-9b56-7b8e5d9dc92e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:38:03.868742 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.wsgi [None req-4b80502d-2448-4ebc-9b56-7b8e5d9dc92e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] HTTP exception thrown: Instance 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c could not be found. Sep 21 12:38:03.870309 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-4b80502d-2448-4ebc-9b56-7b8e5d9dc92e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Request method failure captured: Sep 21 12:38:03.870309 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: request: DELETE /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c HTTP/1.1 Sep 21 12:38:03.870309 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept: application/json Sep 21 12:38:03.870309 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept-Encoding: identity Sep 21 12:38:03.870309 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Connection: close Sep 21 12:38:03.870309 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Length: 0 Sep 21 12:38:03.870309 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Type: application/json Sep 21 12:38:03.870309 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Host: 10.222.0.71 Sep 21 12:38:03.870309 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Openstack-System-Scope: None Sep 21 12:38:03.870309 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: User-Agent: python-urllib3/1.26.12 Sep 21 12:38:03.870309 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Auth-Token: gAAAAABjKwQbqCTIemwdFFQg4iXhIhsYIA26P2YauPIL4u-NnB6IhqS_YvqFD-8J1npMFI_nNFzmN0CnWmYrRfR3q-kNeYlkoz_mojSbL04ZdZGfD7Us18CZ0XAmBUWJA2QleQStXzvqL0eNZfiCAHfkcyv8CGZMSMlFp6BBl5cDKWdeHuqik0o Sep 21 12:38:03.870309 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Id: None Sep 21 12:38:03.870309 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Name: None Sep 21 12:38:03.870309 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Identity-Status: Confirmed Sep 21 12:38:03.870309 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Is-Admin-Project: True Sep 21 12:38:03.870309 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Id: default Sep 21 12:38:03.870309 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Name: Default Sep 21 12:38:03.870309 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Id: bd7f2ef25e054b619068baf878bead18 Sep 21 12:38:03.870309 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Name: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:38:03.870309 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Role: reader,member Sep 21 12:38:03.870309 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Roles: reader,member Sep 21 12:38:03.872046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/bd7f2ef25e054b619068baf878bead18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/bd7f2ef25e054b619068baf878bead18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_bd7f2ef25e054b619068baf878bead18", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/bd7f2ef25e054b619068baf878bead18"}]}] Sep 21 12:38:03.872046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:38:03.872046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Id: bd7f2ef25e054b619068baf878bead18 Sep 21 12:38:03.872046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:38:03.872046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User: tempest-AttachVolumeNegativeTest-367231197-project Sep 21 12:38:03.872046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Id: default Sep 21 12:38:03.872046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Name: Default Sep 21 12:38:03.872046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Id: 90d4dfe489634f3c9346b0ab86408e3b Sep 21 12:38:03.872046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Name: tempest-AttachVolumeNegativeTest-367231197-project Sep 21 12:38:03.872046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: method: > Sep 21 12:38:03.872046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: exception: Instance 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c could not be found. Sep 21 12:38:03.872046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: action_args: {'id': '22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c'} Sep 21 12:38:03.872966 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:38:03.872966 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:03.872966 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:38:03.872966 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:38:03.872966 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:38:03.872966 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:38:03.872966 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:38:03.872966 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:38:03.872966 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:38:03.872966 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:38:03.872966 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c could not be found. Sep 21 12:38:03.872966 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:03.872966 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:38:03.872966 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:03.872966 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:03.872966 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:38:03.872966 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:38:03.872966 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:38:03.872966 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:38:03.872966 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:38:03.874291 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:38:03.874291 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 21 12:38:03.874291 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 21 12:38:03.874291 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 21 12:38:03.874291 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 21 12:38:03.874291 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:38:03.874291 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:38:03.874291 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:38:03.874291 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:38:03.874291 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c could not be found. Sep 21 12:38:03.874291 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:03.874291 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:38:03.874291 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:03.874291 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:03.874291 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:38:03.874291 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:38:03.874291 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:38:03.874291 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:38:03.874291 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c could not be found. Sep 21 12:38:03.874291 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:03.875628 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-4b80502d-2448-4ebc-9b56-7b8e5d9dc92e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Returning 404 to user: Instance 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c could not be found. {{(pid=120463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:38:03.875628 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-4b80502d-2448-4ebc-9b56-7b8e5d9dc92e tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "DELETE /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c" status: 404 len: 111 microversion: 2.1 time: 0.030625 Sep 21 12:38:03.875628 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 572/1158] 10.222.0.71 () {58 vars in 1239 bytes} [Wed Sep 21 12:38:03 2022] DELETE /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:38:03.881955 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-51b53fd7-f6fc-4454-80be-d7c56a94ec28 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:38:03.882717 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-51b53fd7-f6fc-4454-80be-d7c56a94ec28 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:38:03.888869 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-51b53fd7-f6fc-4454-80be-d7c56a94ec28 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:38:03.889351 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-51b53fd7-f6fc-4454-80be-d7c56a94ec28 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:38:03.889793 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-51b53fd7-f6fc-4454-80be-d7c56a94ec28 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:38:03.890482 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-51b53fd7-f6fc-4454-80be-d7c56a94ec28 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:38:03.890968 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-51b53fd7-f6fc-4454-80be-d7c56a94ec28 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:38:03.891392 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-51b53fd7-f6fc-4454-80be-d7c56a94ec28 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:38:03.904593 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.wsgi [None req-51b53fd7-f6fc-4454-80be-d7c56a94ec28 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] HTTP exception thrown: Instance 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c could not be found. Sep 21 12:38:03.906225 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-51b53fd7-f6fc-4454-80be-d7c56a94ec28 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Request method failure captured: Sep 21 12:38:03.906225 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: request: GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c HTTP/1.1 Sep 21 12:38:03.906225 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept: application/json Sep 21 12:38:03.906225 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept-Encoding: identity Sep 21 12:38:03.906225 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Connection: close Sep 21 12:38:03.906225 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Length: 0 Sep 21 12:38:03.906225 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Type: application/json Sep 21 12:38:03.906225 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Host: 10.222.0.71 Sep 21 12:38:03.906225 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Openstack-System-Scope: None Sep 21 12:38:03.906225 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: User-Agent: python-urllib3/1.26.12 Sep 21 12:38:03.906225 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Auth-Token: gAAAAABjKwQbqCTIemwdFFQg4iXhIhsYIA26P2YauPIL4u-NnB6IhqS_YvqFD-8J1npMFI_nNFzmN0CnWmYrRfR3q-kNeYlkoz_mojSbL04ZdZGfD7Us18CZ0XAmBUWJA2QleQStXzvqL0eNZfiCAHfkcyv8CGZMSMlFp6BBl5cDKWdeHuqik0o Sep 21 12:38:03.906225 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Id: None Sep 21 12:38:03.906225 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Name: None Sep 21 12:38:03.906225 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Identity-Status: Confirmed Sep 21 12:38:03.906225 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Is-Admin-Project: True Sep 21 12:38:03.906225 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Id: default Sep 21 12:38:03.906225 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Name: Default Sep 21 12:38:03.906225 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Id: bd7f2ef25e054b619068baf878bead18 Sep 21 12:38:03.906225 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Name: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:38:03.906225 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Role: reader,member Sep 21 12:38:03.906225 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Roles: reader,member Sep 21 12:38:03.907985 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/bd7f2ef25e054b619068baf878bead18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/bd7f2ef25e054b619068baf878bead18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_bd7f2ef25e054b619068baf878bead18", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/bd7f2ef25e054b619068baf878bead18"}]}] Sep 21 12:38:03.907985 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:38:03.907985 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Id: bd7f2ef25e054b619068baf878bead18 Sep 21 12:38:03.907985 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:38:03.907985 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User: tempest-AttachVolumeNegativeTest-367231197-project Sep 21 12:38:03.907985 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Id: default Sep 21 12:38:03.907985 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Name: Default Sep 21 12:38:03.907985 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Id: 90d4dfe489634f3c9346b0ab86408e3b Sep 21 12:38:03.907985 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Name: tempest-AttachVolumeNegativeTest-367231197-project Sep 21 12:38:03.907985 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: method: > Sep 21 12:38:03.907985 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: exception: Instance 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c could not be found. Sep 21 12:38:03.907985 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: action_args: {'id': '22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c'} Sep 21 12:38:03.908990 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:38:03.908990 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:03.908990 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:38:03.908990 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:38:03.908990 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:38:03.908990 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:38:03.908990 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:38:03.908990 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:38:03.908990 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:38:03.908990 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:38:03.908990 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c could not be found. Sep 21 12:38:03.908990 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:38:03.908990 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:38:03.908990 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:38:03.908990 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:03.908990 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:38:03.908990 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:38:03.908990 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:38:03.908990 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:38:03.908990 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:38:03.910557 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:38:03.910557 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 12:38:03.910557 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 12:38:03.910557 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:38:03.910557 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:38:03.910557 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:38:03.910557 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:38:03.910557 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c could not be found. Sep 21 12:38:03.910557 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:38:03.910557 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:38:03.910557 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:38:03.910557 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:03.910557 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:38:03.910557 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:38:03.910557 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:38:03.910557 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:38:03.910557 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c could not be found. Sep 21 12:38:03.910557 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:38:03.914785 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-51b53fd7-f6fc-4454-80be-d7c56a94ec28 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Returning 404 to user: Instance 22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c could not be found. {{(pid=120462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:38:03.914785 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-51b53fd7-f6fc-4454-80be-d7c56a94ec28 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c" status: 404 len: 111 microversion: 2.1 time: 0.030825 Sep 21 12:38:03.914785 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 587/1159] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:38:03 2022] GET /compute/v2.1/servers/22a1d9bf-e4f7-40c5-a385-f3cb2fc1d98c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:38:05.049455 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-6150a157-d3f0-4885-bdff-5c3d3acad25b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:38:05.049955 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-6150a157-d3f0-4885-bdff-5c3d3acad25b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: a8212565-d87b-4a5a-9618-5f3ad4c9c511] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:38:05.056374 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6150a157-d3f0-4885-bdff-5c3d3acad25b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:38:05.056861 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6150a157-d3f0-4885-bdff-5c3d3acad25b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:38:05.057298 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6150a157-d3f0-4885-bdff-5c3d3acad25b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:38:05.057984 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6150a157-d3f0-4885-bdff-5c3d3acad25b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:38:05.058437 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6150a157-d3f0-4885-bdff-5c3d3acad25b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:38:05.058862 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6150a157-d3f0-4885-bdff-5c3d3acad25b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:38:05.073048 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.wsgi [None req-6150a157-d3f0-4885-bdff-5c3d3acad25b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] HTTP exception thrown: Instance a8212565-d87b-4a5a-9618-5f3ad4c9c511 could not be found. Sep 21 12:38:05.074595 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-6150a157-d3f0-4885-bdff-5c3d3acad25b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Request method failure captured: Sep 21 12:38:05.074595 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: request: DELETE /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511 HTTP/1.1 Sep 21 12:38:05.074595 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept: application/json Sep 21 12:38:05.074595 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept-Encoding: identity Sep 21 12:38:05.074595 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Connection: close Sep 21 12:38:05.074595 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Length: 0 Sep 21 12:38:05.074595 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Type: application/json Sep 21 12:38:05.074595 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Host: 10.222.0.71 Sep 21 12:38:05.074595 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Openstack-System-Scope: None Sep 21 12:38:05.074595 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: User-Agent: python-urllib3/1.26.12 Sep 21 12:38:05.074595 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Auth-Token: gAAAAABjKwQbqCTIemwdFFQg4iXhIhsYIA26P2YauPIL4u-NnB6IhqS_YvqFD-8J1npMFI_nNFzmN0CnWmYrRfR3q-kNeYlkoz_mojSbL04ZdZGfD7Us18CZ0XAmBUWJA2QleQStXzvqL0eNZfiCAHfkcyv8CGZMSMlFp6BBl5cDKWdeHuqik0o Sep 21 12:38:05.074595 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Id: None Sep 21 12:38:05.074595 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Name: None Sep 21 12:38:05.074595 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Identity-Status: Confirmed Sep 21 12:38:05.074595 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Is-Admin-Project: True Sep 21 12:38:05.074595 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Id: default Sep 21 12:38:05.074595 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Name: Default Sep 21 12:38:05.074595 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Id: bd7f2ef25e054b619068baf878bead18 Sep 21 12:38:05.074595 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Name: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:38:05.074595 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Role: reader,member Sep 21 12:38:05.074595 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Roles: reader,member Sep 21 12:38:05.076303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/bd7f2ef25e054b619068baf878bead18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/bd7f2ef25e054b619068baf878bead18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_bd7f2ef25e054b619068baf878bead18", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/bd7f2ef25e054b619068baf878bead18"}]}] Sep 21 12:38:05.076303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:38:05.076303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Id: bd7f2ef25e054b619068baf878bead18 Sep 21 12:38:05.076303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:38:05.076303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User: tempest-AttachVolumeNegativeTest-367231197-project Sep 21 12:38:05.076303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Id: default Sep 21 12:38:05.076303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Name: Default Sep 21 12:38:05.076303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Id: 90d4dfe489634f3c9346b0ab86408e3b Sep 21 12:38:05.076303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Name: tempest-AttachVolumeNegativeTest-367231197-project Sep 21 12:38:05.076303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: method: > Sep 21 12:38:05.076303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: exception: Instance a8212565-d87b-4a5a-9618-5f3ad4c9c511 could not be found. Sep 21 12:38:05.076303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: action_args: {'id': 'a8212565-d87b-4a5a-9618-5f3ad4c9c511'} Sep 21 12:38:05.077313 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:38:05.077313 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:05.077313 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:38:05.077313 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:38:05.077313 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:38:05.077313 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:38:05.077313 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:38:05.077313 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:38:05.077313 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:38:05.077313 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:38:05.077313 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8212565-d87b-4a5a-9618-5f3ad4c9c511 could not be found. Sep 21 12:38:05.077313 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:05.077313 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:38:05.077313 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:05.077313 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:05.077313 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:38:05.077313 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:38:05.077313 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:38:05.077313 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:38:05.077313 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:38:05.078886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:38:05.078886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 21 12:38:05.078886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 21 12:38:05.078886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 21 12:38:05.078886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 21 12:38:05.078886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:38:05.078886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:38:05.078886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:38:05.078886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:38:05.078886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8212565-d87b-4a5a-9618-5f3ad4c9c511 could not be found. Sep 21 12:38:05.078886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:05.078886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:38:05.078886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:05.078886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:05.078886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:38:05.078886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:38:05.078886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:38:05.078886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:38:05.078886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8212565-d87b-4a5a-9618-5f3ad4c9c511 could not be found. Sep 21 12:38:05.078886 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:05.080485 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-6150a157-d3f0-4885-bdff-5c3d3acad25b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Returning 404 to user: Instance a8212565-d87b-4a5a-9618-5f3ad4c9c511 could not be found. {{(pid=120463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:38:05.080485 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-6150a157-d3f0-4885-bdff-5c3d3acad25b tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "DELETE /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511" status: 404 len: 111 microversion: 2.1 time: 0.030396 Sep 21 12:38:05.080485 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 573/1160] 10.222.0.71 () {58 vars in 1239 bytes} [Wed Sep 21 12:38:05 2022] DELETE /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:38:05.085153 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-a32bf4cf-afa2-4798-861b-acbf0d36ad9f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:38:05.085776 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-a32bf4cf-afa2-4798-861b-acbf0d36ad9f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: a8212565-d87b-4a5a-9618-5f3ad4c9c511] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:38:05.092510 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a32bf4cf-afa2-4798-861b-acbf0d36ad9f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:38:05.093030 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a32bf4cf-afa2-4798-861b-acbf0d36ad9f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:38:05.093475 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a32bf4cf-afa2-4798-861b-acbf0d36ad9f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:38:05.094175 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a32bf4cf-afa2-4798-861b-acbf0d36ad9f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:38:05.094635 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a32bf4cf-afa2-4798-861b-acbf0d36ad9f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:38:05.095062 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a32bf4cf-afa2-4798-861b-acbf0d36ad9f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:38:05.108398 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.wsgi [None req-a32bf4cf-afa2-4798-861b-acbf0d36ad9f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] HTTP exception thrown: Instance a8212565-d87b-4a5a-9618-5f3ad4c9c511 could not be found. Sep 21 12:38:05.109936 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-a32bf4cf-afa2-4798-861b-acbf0d36ad9f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Request method failure captured: Sep 21 12:38:05.109936 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: request: GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511 HTTP/1.1 Sep 21 12:38:05.109936 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept: application/json Sep 21 12:38:05.109936 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept-Encoding: identity Sep 21 12:38:05.109936 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Connection: close Sep 21 12:38:05.109936 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Length: 0 Sep 21 12:38:05.109936 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Type: application/json Sep 21 12:38:05.109936 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Host: 10.222.0.71 Sep 21 12:38:05.109936 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Openstack-System-Scope: None Sep 21 12:38:05.109936 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: User-Agent: python-urllib3/1.26.12 Sep 21 12:38:05.109936 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Auth-Token: gAAAAABjKwQbqCTIemwdFFQg4iXhIhsYIA26P2YauPIL4u-NnB6IhqS_YvqFD-8J1npMFI_nNFzmN0CnWmYrRfR3q-kNeYlkoz_mojSbL04ZdZGfD7Us18CZ0XAmBUWJA2QleQStXzvqL0eNZfiCAHfkcyv8CGZMSMlFp6BBl5cDKWdeHuqik0o Sep 21 12:38:05.109936 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Id: None Sep 21 12:38:05.109936 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Name: None Sep 21 12:38:05.109936 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Identity-Status: Confirmed Sep 21 12:38:05.109936 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Is-Admin-Project: True Sep 21 12:38:05.109936 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Id: default Sep 21 12:38:05.109936 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Name: Default Sep 21 12:38:05.109936 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Id: bd7f2ef25e054b619068baf878bead18 Sep 21 12:38:05.109936 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Name: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:38:05.109936 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Role: reader,member Sep 21 12:38:05.109936 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Roles: reader,member Sep 21 12:38:05.112579 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/bd7f2ef25e054b619068baf878bead18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/bd7f2ef25e054b619068baf878bead18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_bd7f2ef25e054b619068baf878bead18", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/bd7f2ef25e054b619068baf878bead18"}]}] Sep 21 12:38:05.112579 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:38:05.112579 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Id: bd7f2ef25e054b619068baf878bead18 Sep 21 12:38:05.112579 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:38:05.112579 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User: tempest-AttachVolumeNegativeTest-367231197-project Sep 21 12:38:05.112579 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Id: default Sep 21 12:38:05.112579 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Name: Default Sep 21 12:38:05.112579 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Id: 90d4dfe489634f3c9346b0ab86408e3b Sep 21 12:38:05.112579 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Name: tempest-AttachVolumeNegativeTest-367231197-project Sep 21 12:38:05.112579 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: method: > Sep 21 12:38:05.112579 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: exception: Instance a8212565-d87b-4a5a-9618-5f3ad4c9c511 could not be found. Sep 21 12:38:05.112579 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: action_args: {'id': 'a8212565-d87b-4a5a-9618-5f3ad4c9c511'} Sep 21 12:38:05.114333 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:38:05.114333 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:05.114333 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:38:05.114333 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:38:05.114333 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:38:05.114333 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:38:05.114333 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:38:05.114333 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:38:05.114333 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:38:05.114333 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:38:05.114333 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8212565-d87b-4a5a-9618-5f3ad4c9c511 could not be found. Sep 21 12:38:05.114333 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:38:05.114333 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:38:05.114333 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:38:05.114333 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:05.114333 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:38:05.114333 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:38:05.114333 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:38:05.114333 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:38:05.114333 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:38:05.117128 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:38:05.117128 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 12:38:05.117128 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 12:38:05.117128 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:38:05.117128 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:38:05.117128 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:38:05.117128 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:38:05.117128 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8212565-d87b-4a5a-9618-5f3ad4c9c511 could not be found. Sep 21 12:38:05.117128 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:38:05.117128 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:38:05.117128 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:38:05.117128 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:05.117128 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:38:05.117128 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:38:05.117128 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:38:05.117128 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:38:05.117128 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8212565-d87b-4a5a-9618-5f3ad4c9c511 could not be found. Sep 21 12:38:05.117128 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:38:05.119361 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-a32bf4cf-afa2-4798-861b-acbf0d36ad9f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Returning 404 to user: Instance a8212565-d87b-4a5a-9618-5f3ad4c9c511 could not be found. {{(pid=120462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:38:05.119361 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-a32bf4cf-afa2-4798-861b-acbf0d36ad9f tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511" status: 404 len: 111 microversion: 2.1 time: 0.030787 Sep 21 12:38:05.119361 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 588/1161] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:38:05 2022] GET /compute/v2.1/servers/a8212565-d87b-4a5a-9618-5f3ad4c9c511 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:38:05.121137 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-166ffc79-9c6b-4449-9af7-fb93a609a299 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:38:05.121636 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-166ffc79-9c6b-4449-9af7-fb93a609a299 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 136bd64b-32e2-4d7c-b864-99becaf61714] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:38:05.127472 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-166ffc79-9c6b-4449-9af7-fb93a609a299 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:38:05.127991 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-166ffc79-9c6b-4449-9af7-fb93a609a299 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:38:05.128429 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-166ffc79-9c6b-4449-9af7-fb93a609a299 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:38:05.129114 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-166ffc79-9c6b-4449-9af7-fb93a609a299 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:38:05.129566 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-166ffc79-9c6b-4449-9af7-fb93a609a299 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:38:05.130562 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-166ffc79-9c6b-4449-9af7-fb93a609a299 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:38:05.143694 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.wsgi [None req-166ffc79-9c6b-4449-9af7-fb93a609a299 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] HTTP exception thrown: Instance 136bd64b-32e2-4d7c-b864-99becaf61714 could not be found. Sep 21 12:38:05.145380 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-166ffc79-9c6b-4449-9af7-fb93a609a299 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Request method failure captured: Sep 21 12:38:05.145380 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: request: DELETE /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714 HTTP/1.1 Sep 21 12:38:05.145380 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept: application/json Sep 21 12:38:05.145380 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept-Encoding: identity Sep 21 12:38:05.145380 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Connection: close Sep 21 12:38:05.145380 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Length: 0 Sep 21 12:38:05.145380 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Type: application/json Sep 21 12:38:05.145380 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Host: 10.222.0.71 Sep 21 12:38:05.145380 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Openstack-System-Scope: None Sep 21 12:38:05.145380 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: User-Agent: python-urllib3/1.26.12 Sep 21 12:38:05.145380 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Auth-Token: gAAAAABjKwQbqCTIemwdFFQg4iXhIhsYIA26P2YauPIL4u-NnB6IhqS_YvqFD-8J1npMFI_nNFzmN0CnWmYrRfR3q-kNeYlkoz_mojSbL04ZdZGfD7Us18CZ0XAmBUWJA2QleQStXzvqL0eNZfiCAHfkcyv8CGZMSMlFp6BBl5cDKWdeHuqik0o Sep 21 12:38:05.145380 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Id: None Sep 21 12:38:05.145380 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Name: None Sep 21 12:38:05.145380 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Identity-Status: Confirmed Sep 21 12:38:05.145380 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Is-Admin-Project: True Sep 21 12:38:05.145380 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Id: default Sep 21 12:38:05.145380 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Name: Default Sep 21 12:38:05.145380 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Id: bd7f2ef25e054b619068baf878bead18 Sep 21 12:38:05.145380 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Name: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:38:05.145380 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Role: reader,member Sep 21 12:38:05.145380 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Roles: reader,member Sep 21 12:38:05.147455 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/bd7f2ef25e054b619068baf878bead18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/bd7f2ef25e054b619068baf878bead18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_bd7f2ef25e054b619068baf878bead18", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/bd7f2ef25e054b619068baf878bead18"}]}] Sep 21 12:38:05.147455 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:38:05.147455 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Id: bd7f2ef25e054b619068baf878bead18 Sep 21 12:38:05.147455 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:38:05.147455 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User: tempest-AttachVolumeNegativeTest-367231197-project Sep 21 12:38:05.147455 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Id: default Sep 21 12:38:05.147455 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Name: Default Sep 21 12:38:05.147455 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Id: 90d4dfe489634f3c9346b0ab86408e3b Sep 21 12:38:05.147455 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Name: tempest-AttachVolumeNegativeTest-367231197-project Sep 21 12:38:05.147455 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: method: > Sep 21 12:38:05.147455 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: exception: Instance 136bd64b-32e2-4d7c-b864-99becaf61714 could not be found. Sep 21 12:38:05.147455 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: action_args: {'id': '136bd64b-32e2-4d7c-b864-99becaf61714'} Sep 21 12:38:05.148535 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:38:05.148535 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:05.148535 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:38:05.148535 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:38:05.148535 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:38:05.148535 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:38:05.148535 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:38:05.148535 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:38:05.148535 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:38:05.148535 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:38:05.148535 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 136bd64b-32e2-4d7c-b864-99becaf61714 could not be found. Sep 21 12:38:05.148535 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:05.148535 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:38:05.148535 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:05.148535 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:05.148535 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:38:05.148535 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:38:05.148535 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:38:05.148535 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:38:05.148535 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:38:05.150031 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:38:05.150031 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 21 12:38:05.150031 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 21 12:38:05.150031 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 21 12:38:05.150031 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 21 12:38:05.150031 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:38:05.150031 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:38:05.150031 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:38:05.150031 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:38:05.150031 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 136bd64b-32e2-4d7c-b864-99becaf61714 could not be found. Sep 21 12:38:05.150031 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:05.150031 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:38:05.150031 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:05.150031 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:05.150031 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:38:05.150031 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:38:05.150031 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:38:05.150031 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:38:05.150031 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 136bd64b-32e2-4d7c-b864-99becaf61714 could not be found. Sep 21 12:38:05.150031 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:05.151640 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-166ffc79-9c6b-4449-9af7-fb93a609a299 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Returning 404 to user: Instance 136bd64b-32e2-4d7c-b864-99becaf61714 could not be found. {{(pid=120463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:38:05.151640 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-166ffc79-9c6b-4449-9af7-fb93a609a299 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "DELETE /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714" status: 404 len: 111 microversion: 2.1 time: 0.029871 Sep 21 12:38:05.151640 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 574/1162] 10.222.0.71 () {58 vars in 1239 bytes} [Wed Sep 21 12:38:05 2022] DELETE /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:38:05.155461 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-6615c113-d9fb-4c87-956f-8c1abbace959 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:38:05.156107 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-6615c113-d9fb-4c87-956f-8c1abbace959 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: 136bd64b-32e2-4d7c-b864-99becaf61714] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:38:05.162070 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6615c113-d9fb-4c87-956f-8c1abbace959 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:38:05.162553 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6615c113-d9fb-4c87-956f-8c1abbace959 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:38:05.162984 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6615c113-d9fb-4c87-956f-8c1abbace959 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:38:05.163668 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6615c113-d9fb-4c87-956f-8c1abbace959 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:38:05.164145 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6615c113-d9fb-4c87-956f-8c1abbace959 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:38:05.164569 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6615c113-d9fb-4c87-956f-8c1abbace959 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:38:05.177811 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.wsgi [None req-6615c113-d9fb-4c87-956f-8c1abbace959 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] HTTP exception thrown: Instance 136bd64b-32e2-4d7c-b864-99becaf61714 could not be found. Sep 21 12:38:05.179325 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-6615c113-d9fb-4c87-956f-8c1abbace959 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Request method failure captured: Sep 21 12:38:05.179325 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: request: GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714 HTTP/1.1 Sep 21 12:38:05.179325 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept: application/json Sep 21 12:38:05.179325 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept-Encoding: identity Sep 21 12:38:05.179325 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Connection: close Sep 21 12:38:05.179325 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Length: 0 Sep 21 12:38:05.179325 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Type: application/json Sep 21 12:38:05.179325 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Host: 10.222.0.71 Sep 21 12:38:05.179325 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Openstack-System-Scope: None Sep 21 12:38:05.179325 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: User-Agent: python-urllib3/1.26.12 Sep 21 12:38:05.179325 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Auth-Token: gAAAAABjKwQbqCTIemwdFFQg4iXhIhsYIA26P2YauPIL4u-NnB6IhqS_YvqFD-8J1npMFI_nNFzmN0CnWmYrRfR3q-kNeYlkoz_mojSbL04ZdZGfD7Us18CZ0XAmBUWJA2QleQStXzvqL0eNZfiCAHfkcyv8CGZMSMlFp6BBl5cDKWdeHuqik0o Sep 21 12:38:05.179325 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Id: None Sep 21 12:38:05.179325 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Name: None Sep 21 12:38:05.179325 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Identity-Status: Confirmed Sep 21 12:38:05.179325 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Is-Admin-Project: True Sep 21 12:38:05.179325 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Id: default Sep 21 12:38:05.179325 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Name: Default Sep 21 12:38:05.179325 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Id: bd7f2ef25e054b619068baf878bead18 Sep 21 12:38:05.179325 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Name: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:38:05.179325 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Role: reader,member Sep 21 12:38:05.179325 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Roles: reader,member Sep 21 12:38:05.181135 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/bd7f2ef25e054b619068baf878bead18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/bd7f2ef25e054b619068baf878bead18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_bd7f2ef25e054b619068baf878bead18", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/bd7f2ef25e054b619068baf878bead18"}]}] Sep 21 12:38:05.181135 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:38:05.181135 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Id: bd7f2ef25e054b619068baf878bead18 Sep 21 12:38:05.181135 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:38:05.181135 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User: tempest-AttachVolumeNegativeTest-367231197-project Sep 21 12:38:05.181135 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Id: default Sep 21 12:38:05.181135 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Name: Default Sep 21 12:38:05.181135 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Id: 90d4dfe489634f3c9346b0ab86408e3b Sep 21 12:38:05.181135 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Name: tempest-AttachVolumeNegativeTest-367231197-project Sep 21 12:38:05.181135 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: method: > Sep 21 12:38:05.181135 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: exception: Instance 136bd64b-32e2-4d7c-b864-99becaf61714 could not be found. Sep 21 12:38:05.181135 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: action_args: {'id': '136bd64b-32e2-4d7c-b864-99becaf61714'} Sep 21 12:38:05.182201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:38:05.182201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:05.182201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:38:05.182201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:38:05.182201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:38:05.182201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:38:05.182201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:38:05.182201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:38:05.182201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:38:05.182201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:38:05.182201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 136bd64b-32e2-4d7c-b864-99becaf61714 could not be found. Sep 21 12:38:05.182201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:38:05.182201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:38:05.182201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:38:05.182201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:05.182201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:38:05.182201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:38:05.182201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:38:05.182201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:38:05.182201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:38:05.183792 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:38:05.183792 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 12:38:05.183792 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 12:38:05.183792 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:38:05.183792 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:38:05.183792 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:38:05.183792 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:38:05.183792 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 136bd64b-32e2-4d7c-b864-99becaf61714 could not be found. Sep 21 12:38:05.183792 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:38:05.183792 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:38:05.183792 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:38:05.183792 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:05.183792 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:38:05.183792 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:38:05.183792 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:38:05.183792 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:38:05.183792 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 136bd64b-32e2-4d7c-b864-99becaf61714 could not be found. Sep 21 12:38:05.183792 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:38:05.185193 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-6615c113-d9fb-4c87-956f-8c1abbace959 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Returning 404 to user: Instance 136bd64b-32e2-4d7c-b864-99becaf61714 could not be found. {{(pid=120462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:38:05.185193 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-6615c113-d9fb-4c87-956f-8c1abbace959 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714" status: 404 len: 111 microversion: 2.1 time: 0.029097 Sep 21 12:38:05.185193 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 589/1163] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:38:05 2022] GET /compute/v2.1/servers/136bd64b-32e2-4d7c-b864-99becaf61714 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:38:06.325444 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-c03624bc-59d2-4aa2-8de6-cfb244fb40f5 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:38:06.326002 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-c03624bc-59d2-4aa2-8de6-cfb244fb40f5 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: e17630cc-94bc-4b00-a64e-3c092f04cb1a] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:38:06.332832 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c03624bc-59d2-4aa2-8de6-cfb244fb40f5 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:38:06.333326 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c03624bc-59d2-4aa2-8de6-cfb244fb40f5 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:38:06.333772 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c03624bc-59d2-4aa2-8de6-cfb244fb40f5 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:38:06.334490 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c03624bc-59d2-4aa2-8de6-cfb244fb40f5 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:38:06.334951 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c03624bc-59d2-4aa2-8de6-cfb244fb40f5 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:38:06.335388 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-c03624bc-59d2-4aa2-8de6-cfb244fb40f5 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:38:06.349018 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.wsgi [None req-c03624bc-59d2-4aa2-8de6-cfb244fb40f5 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] HTTP exception thrown: Instance e17630cc-94bc-4b00-a64e-3c092f04cb1a could not be found. Sep 21 12:38:06.350713 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-c03624bc-59d2-4aa2-8de6-cfb244fb40f5 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Request method failure captured: Sep 21 12:38:06.350713 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: request: DELETE /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a HTTP/1.1 Sep 21 12:38:06.350713 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept: application/json Sep 21 12:38:06.350713 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept-Encoding: identity Sep 21 12:38:06.350713 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Connection: close Sep 21 12:38:06.350713 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Length: 0 Sep 21 12:38:06.350713 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Type: application/json Sep 21 12:38:06.350713 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Host: 10.222.0.71 Sep 21 12:38:06.350713 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Openstack-System-Scope: None Sep 21 12:38:06.350713 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: User-Agent: python-urllib3/1.26.12 Sep 21 12:38:06.350713 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Auth-Token: gAAAAABjKwQbqCTIemwdFFQg4iXhIhsYIA26P2YauPIL4u-NnB6IhqS_YvqFD-8J1npMFI_nNFzmN0CnWmYrRfR3q-kNeYlkoz_mojSbL04ZdZGfD7Us18CZ0XAmBUWJA2QleQStXzvqL0eNZfiCAHfkcyv8CGZMSMlFp6BBl5cDKWdeHuqik0o Sep 21 12:38:06.350713 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Id: None Sep 21 12:38:06.350713 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Name: None Sep 21 12:38:06.350713 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Identity-Status: Confirmed Sep 21 12:38:06.350713 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Is-Admin-Project: True Sep 21 12:38:06.350713 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Id: default Sep 21 12:38:06.350713 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Name: Default Sep 21 12:38:06.350713 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Id: bd7f2ef25e054b619068baf878bead18 Sep 21 12:38:06.350713 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Name: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:38:06.350713 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Role: reader,member Sep 21 12:38:06.350713 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Roles: reader,member Sep 21 12:38:06.352396 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/bd7f2ef25e054b619068baf878bead18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/bd7f2ef25e054b619068baf878bead18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_bd7f2ef25e054b619068baf878bead18", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/bd7f2ef25e054b619068baf878bead18"}]}] Sep 21 12:38:06.352396 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:38:06.352396 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Id: bd7f2ef25e054b619068baf878bead18 Sep 21 12:38:06.352396 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:38:06.352396 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User: tempest-AttachVolumeNegativeTest-367231197-project Sep 21 12:38:06.352396 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Id: default Sep 21 12:38:06.352396 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Name: Default Sep 21 12:38:06.352396 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Id: 90d4dfe489634f3c9346b0ab86408e3b Sep 21 12:38:06.352396 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Name: tempest-AttachVolumeNegativeTest-367231197-project Sep 21 12:38:06.352396 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: method: > Sep 21 12:38:06.352396 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: exception: Instance e17630cc-94bc-4b00-a64e-3c092f04cb1a could not be found. Sep 21 12:38:06.352396 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: action_args: {'id': 'e17630cc-94bc-4b00-a64e-3c092f04cb1a'} Sep 21 12:38:06.353428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:38:06.353428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:06.353428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:38:06.353428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:38:06.353428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:38:06.353428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:38:06.353428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:38:06.353428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:38:06.353428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:38:06.353428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:38:06.353428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e17630cc-94bc-4b00-a64e-3c092f04cb1a could not be found. Sep 21 12:38:06.353428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:06.353428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:38:06.353428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:06.353428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:06.353428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:38:06.353428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:38:06.353428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:38:06.353428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:38:06.353428 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:38:06.354992 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:38:06.354992 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 21 12:38:06.354992 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 21 12:38:06.354992 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 21 12:38:06.354992 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 21 12:38:06.354992 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:38:06.354992 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:38:06.354992 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:38:06.354992 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:38:06.354992 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e17630cc-94bc-4b00-a64e-3c092f04cb1a could not be found. Sep 21 12:38:06.354992 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:06.354992 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:38:06.354992 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:06.354992 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:06.354992 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:38:06.354992 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:38:06.354992 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:38:06.354992 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:38:06.354992 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e17630cc-94bc-4b00-a64e-3c092f04cb1a could not be found. Sep 21 12:38:06.354992 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:06.356609 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-c03624bc-59d2-4aa2-8de6-cfb244fb40f5 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Returning 404 to user: Instance e17630cc-94bc-4b00-a64e-3c092f04cb1a could not be found. {{(pid=120463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:38:06.356609 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-c03624bc-59d2-4aa2-8de6-cfb244fb40f5 tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "DELETE /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a" status: 404 len: 111 microversion: 2.1 time: 0.030531 Sep 21 12:38:06.356609 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 575/1164] 10.222.0.71 () {58 vars in 1239 bytes} [Wed Sep 21 12:38:06 2022] DELETE /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:38:06.360583 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-545f7c4b-3839-4dad-a085-6e1f4813a47d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:38:06.361229 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-545f7c4b-3839-4dad-a085-6e1f4813a47d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] [instance: e17630cc-94bc-4b00-a64e-3c092f04cb1a] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:38:06.368359 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-545f7c4b-3839-4dad-a085-6e1f4813a47d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:38:06.368686 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-545f7c4b-3839-4dad-a085-6e1f4813a47d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:38:06.369129 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-545f7c4b-3839-4dad-a085-6e1f4813a47d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:38:06.369825 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-545f7c4b-3839-4dad-a085-6e1f4813a47d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:38:06.370280 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-545f7c4b-3839-4dad-a085-6e1f4813a47d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:38:06.370707 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-545f7c4b-3839-4dad-a085-6e1f4813a47d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:38:06.384606 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.wsgi [None req-545f7c4b-3839-4dad-a085-6e1f4813a47d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] HTTP exception thrown: Instance e17630cc-94bc-4b00-a64e-3c092f04cb1a could not be found. Sep 21 12:38:06.386141 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-545f7c4b-3839-4dad-a085-6e1f4813a47d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Request method failure captured: Sep 21 12:38:06.386141 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: request: GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a HTTP/1.1 Sep 21 12:38:06.386141 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept: application/json Sep 21 12:38:06.386141 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept-Encoding: identity Sep 21 12:38:06.386141 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Connection: close Sep 21 12:38:06.386141 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Length: 0 Sep 21 12:38:06.386141 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Type: application/json Sep 21 12:38:06.386141 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Host: 10.222.0.71 Sep 21 12:38:06.386141 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Openstack-System-Scope: None Sep 21 12:38:06.386141 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: User-Agent: python-urllib3/1.26.12 Sep 21 12:38:06.386141 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Auth-Token: gAAAAABjKwQbqCTIemwdFFQg4iXhIhsYIA26P2YauPIL4u-NnB6IhqS_YvqFD-8J1npMFI_nNFzmN0CnWmYrRfR3q-kNeYlkoz_mojSbL04ZdZGfD7Us18CZ0XAmBUWJA2QleQStXzvqL0eNZfiCAHfkcyv8CGZMSMlFp6BBl5cDKWdeHuqik0o Sep 21 12:38:06.386141 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Id: None Sep 21 12:38:06.386141 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Name: None Sep 21 12:38:06.386141 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Identity-Status: Confirmed Sep 21 12:38:06.386141 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Is-Admin-Project: True Sep 21 12:38:06.386141 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Id: default Sep 21 12:38:06.386141 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Name: Default Sep 21 12:38:06.386141 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Id: bd7f2ef25e054b619068baf878bead18 Sep 21 12:38:06.386141 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Name: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:38:06.386141 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Role: reader,member Sep 21 12:38:06.386141 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Roles: reader,member Sep 21 12:38:06.387848 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/bd7f2ef25e054b619068baf878bead18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/bd7f2ef25e054b619068baf878bead18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_bd7f2ef25e054b619068baf878bead18", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/bd7f2ef25e054b619068baf878bead18"}]}] Sep 21 12:38:06.387848 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:38:06.387848 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Id: bd7f2ef25e054b619068baf878bead18 Sep 21 12:38:06.387848 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-367231197 Sep 21 12:38:06.387848 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User: tempest-AttachVolumeNegativeTest-367231197-project Sep 21 12:38:06.387848 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Id: default Sep 21 12:38:06.387848 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Name: Default Sep 21 12:38:06.387848 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Id: 90d4dfe489634f3c9346b0ab86408e3b Sep 21 12:38:06.387848 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Name: tempest-AttachVolumeNegativeTest-367231197-project Sep 21 12:38:06.387848 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: method: > Sep 21 12:38:06.387848 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: exception: Instance e17630cc-94bc-4b00-a64e-3c092f04cb1a could not be found. Sep 21 12:38:06.387848 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: action_args: {'id': 'e17630cc-94bc-4b00-a64e-3c092f04cb1a'} Sep 21 12:38:06.392359 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:38:06.392359 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:06.392359 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:38:06.392359 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:38:06.392359 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:38:06.392359 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:38:06.392359 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:38:06.392359 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:38:06.392359 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:38:06.392359 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:38:06.392359 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e17630cc-94bc-4b00-a64e-3c092f04cb1a could not be found. Sep 21 12:38:06.392359 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:38:06.392359 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:38:06.392359 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:38:06.392359 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:06.392359 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:38:06.392359 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:38:06.392359 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:38:06.392359 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:38:06.392359 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:38:06.394404 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:38:06.394404 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 12:38:06.394404 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 12:38:06.394404 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:38:06.394404 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:38:06.394404 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:38:06.394404 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:38:06.394404 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e17630cc-94bc-4b00-a64e-3c092f04cb1a could not be found. Sep 21 12:38:06.394404 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:38:06.394404 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:38:06.394404 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:38:06.394404 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:06.394404 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:38:06.394404 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:38:06.394404 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:38:06.394404 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:38:06.394404 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e17630cc-94bc-4b00-a64e-3c092f04cb1a could not be found. Sep 21 12:38:06.394404 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:38:06.396049 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-545f7c4b-3839-4dad-a085-6e1f4813a47d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] Returning 404 to user: Instance e17630cc-94bc-4b00-a64e-3c092f04cb1a could not be found. {{(pid=120462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:38:06.396049 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-545f7c4b-3839-4dad-a085-6e1f4813a47d tempest-AttachVolumeNegativeTest-367231197 tempest-AttachVolumeNegativeTest-367231197-project] 10.222.0.71 "GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a" status: 404 len: 111 microversion: 2.1 time: 0.030787 Sep 21 12:38:06.396049 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 590/1165] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:38:06 2022] GET /compute/v2.1/servers/e17630cc-94bc-4b00-a64e-3c092f04cb1a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:38:10.706366 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-e53babd4-e75f-4f10-866b-7e81e51e1e0e tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] Action: 'create', calling method: .version_select at 0x7fe4c8c83af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2072287017"}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:38:11.006755 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-e53babd4-e75f-4f10-866b-7e81e51e1e0e tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] 10.222.0.71 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.413882 Sep 21 12:38:11.007403 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 576/1166] 10.222.0.71 () {60 vars in 1155 bytes} [Wed Sep 21 12:38:10 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 415 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 21 12:38:11.019982 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-71f17832-ccf5-4e24-b8c3-f16b3d14a211 tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] Calling method '.version_select at 0x7fe4cc65aca0>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:38:11.068928 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-71f17832-ccf5-4e24-b8c3-f16b3d14a211 tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9" status: 200 len: 345 microversion: 2.1 time: 0.052718 Sep 21 12:38:11.069506 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 591/1167] 10.222.0.71 () {58 vars in 1245 bytes} [Wed Sep 21 12:38:11 2022] GET /compute/v2.1/os-volumes/cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:38:12.084709 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-413aaf08-f989-435d-a5a4-7c9e0fafbf21 tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] Calling method '.version_select at 0x7fe4c8f5b430>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:38:12.133213 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-413aaf08-f989-435d-a5a4-7c9e0fafbf21 tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9" status: 200 len: 346 microversion: 2.1 time: 0.053427 Sep 21 12:38:12.133890 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 577/1168] 10.222.0.71 () {58 vars in 1245 bytes} [Wed Sep 21 12:38:12 2022] GET /compute/v2.1/os-volumes/cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9 => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:38:12.147342 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-a3e9a584-a97f-4aa9-949d-61871364ee16 tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] Action: 'create', calling method: .version_select at 0x7fe4c905f790>, body: {"snapshot": {"volume_id": "cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2030634604"}} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:38:12.309121 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-a3e9a584-a97f-4aa9-949d-61871364ee16 tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] 10.222.0.71 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.166168 Sep 21 12:38:12.309714 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 592/1169] 10.222.0.71 () {60 vars in 1162 bytes} [Wed Sep 21 12:38:12 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:38:12.321902 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-d6d9bbe0-05fb-418d-b8cd-7067d8f1911b tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] Calling method '.version_select at 0x7fe4c8fd05e0>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:38:12.358196 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-d6d9bbe0-05fb-418d-b8cd-7067d8f1911b tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/20321f98-7b01-469a-a28b-f2543e754d9c" status: 200 len: 287 microversion: 2.1 time: 0.040963 Sep 21 12:38:12.359103 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 578/1170] 10.222.0.71 () {58 vars in 1251 bytes} [Wed Sep 21 12:38:12 2022] GET /compute/v2.1/os-snapshots/20321f98-7b01-469a-a28b-f2543e754d9c => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:38:12.370944 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-44977fef-7b27-4357-92b1-6c4f28dec280 tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] Calling method '.version_select at 0x7fe4cc6d54c0>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:38:12.402201 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-44977fef-7b27-4357-92b1-6c4f28dec280 tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035222 Sep 21 12:38:12.402849 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 593/1171] 10.222.0.71 () {58 vars in 1140 bytes} [Wed Sep 21 12:38:12 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:38:12.414724 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-d1c6921b-ee1b-497e-b981-72f0f7397391 tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] Calling method '.version_select at 0x7fe4c8e404c0>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:38:12.444271 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-d1c6921b-ee1b-497e-b981-72f0f7397391 tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/20321f98-7b01-469a-a28b-f2543e754d9c" status: 200 len: 287 microversion: 2.1 time: 0.033824 Sep 21 12:38:12.444841 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 579/1172] 10.222.0.71 () {58 vars in 1251 bytes} [Wed Sep 21 12:38:12 2022] GET /compute/v2.1/os-snapshots/20321f98-7b01-469a-a28b-f2543e754d9c => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:38:13.458203 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-52862f25-33db-4dcf-b956-c524b947322a tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] Calling method '.version_select at 0x7fe4c905fee0>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:38:13.487430 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-52862f25-33db-4dcf-b956-c524b947322a tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/20321f98-7b01-469a-a28b-f2543e754d9c" status: 200 len: 287 microversion: 2.1 time: 0.034054 Sep 21 12:38:13.488030 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 594/1173] 10.222.0.71 () {58 vars in 1251 bytes} [Wed Sep 21 12:38:13 2022] GET /compute/v2.1/os-snapshots/20321f98-7b01-469a-a28b-f2543e754d9c => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:38:14.501877 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-640ff7d5-9108-4f7f-83bb-7326d97de1da tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] Calling method '.version_select at 0x7fe4c8de4550>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:38:14.532002 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-640ff7d5-9108-4f7f-83bb-7326d97de1da tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/20321f98-7b01-469a-a28b-f2543e754d9c" status: 200 len: 287 microversion: 2.1 time: 0.034435 Sep 21 12:38:14.532561 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 580/1174] 10.222.0.71 () {58 vars in 1251 bytes} [Wed Sep 21 12:38:14 2022] GET /compute/v2.1/os-snapshots/20321f98-7b01-469a-a28b-f2543e754d9c => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:38:15.546729 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-04ab8c6f-aa2f-491f-8a5b-65a7986188a3 tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] Calling method '.version_select at 0x7fe4cc61c820>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:38:15.577714 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-04ab8c6f-aa2f-491f-8a5b-65a7986188a3 tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/20321f98-7b01-469a-a28b-f2543e754d9c" status: 200 len: 287 microversion: 2.1 time: 0.035847 Sep 21 12:38:15.578477 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 595/1175] 10.222.0.71 () {58 vars in 1251 bytes} [Wed Sep 21 12:38:15 2022] GET /compute/v2.1/os-snapshots/20321f98-7b01-469a-a28b-f2543e754d9c => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:38:16.587962 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=11 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:38:16.588978 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=15 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:38:16.593656 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-4995ae8e-bd37-4f22-8e0f-6f721e6d8c6a tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] Calling method '.version_select at 0x7fe4c8dd7550>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:38:16.623859 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-4995ae8e-bd37-4f22-8e0f-6f721e6d8c6a tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/20321f98-7b01-469a-a28b-f2543e754d9c" status: 200 len: 287 microversion: 2.1 time: 0.036996 Sep 21 12:38:16.624446 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 581/1176] 10.222.0.71 () {58 vars in 1251 bytes} [Wed Sep 21 12:38:16 2022] GET /compute/v2.1/os-snapshots/20321f98-7b01-469a-a28b-f2543e754d9c => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:38:17.635945 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:38:17.636983 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=15 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:38:17.642574 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-07c91230-8f8e-4bf5-bf9d-273599223401 tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] Calling method '.version_select at 0x7fe4cc62c1f0>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:38:17.673334 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-07c91230-8f8e-4bf5-bf9d-273599223401 tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/20321f98-7b01-469a-a28b-f2543e754d9c" status: 200 len: 288 microversion: 2.1 time: 0.038401 Sep 21 12:38:17.673914 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 596/1177] 10.222.0.71 () {58 vars in 1251 bytes} [Wed Sep 21 12:38:17 2022] GET /compute/v2.1/os-snapshots/20321f98-7b01-469a-a28b-f2543e754d9c => generated 288 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:38:17.685747 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-69b79d2d-8ce4-40b9-a0e3-a1ba1e82d76d tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] Calling method '.version_select at 0x7fe4c8c83b80>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:38:17.743032 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-69b79d2d-8ce4-40b9-a0e3-a1ba1e82d76d tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] 10.222.0.71 "DELETE /compute/v2.1/os-snapshots/20321f98-7b01-469a-a28b-f2543e754d9c" status: 202 len: 0 microversion: 2.1 time: 0.061548 Sep 21 12:38:17.743619 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 582/1178] 10.222.0.71 () {58 vars in 1254 bytes} [Wed Sep 21 12:38:17 2022] DELETE /compute/v2.1/os-snapshots/20321f98-7b01-469a-a28b-f2543e754d9c => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 12:38:17.752385 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-022f5f93-c72b-4c3b-b165-1d411f087e7d tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] Calling method '.version_select at 0x7fe4cc62cc10>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:38:17.783041 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-022f5f93-c72b-4c3b-b165-1d411f087e7d tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/20321f98-7b01-469a-a28b-f2543e754d9c" status: 200 len: 287 microversion: 2.1 time: 0.034897 Sep 21 12:38:17.783608 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 597/1179] 10.222.0.71 () {58 vars in 1251 bytes} [Wed Sep 21 12:38:17 2022] GET /compute/v2.1/os-snapshots/20321f98-7b01-469a-a28b-f2543e754d9c => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:38:18.796595 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-92aa6a21-b061-4a8a-a173-37fd08d93d47 tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] Calling method '.version_select at 0x7fe4c8dc8430>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:38:18.821792 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.wsgi [None req-92aa6a21-b061-4a8a-a173-37fd08d93d47 tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] HTTP exception thrown: Snapshot 20321f98-7b01-469a-a28b-f2543e754d9c could not be found. Sep 21 12:38:18.824229 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-92aa6a21-b061-4a8a-a173-37fd08d93d47 tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] Request method failure captured: Sep 21 12:38:18.824229 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: request: GET /compute/v2.1/os-snapshots/20321f98-7b01-469a-a28b-f2543e754d9c HTTP/1.1 Sep 21 12:38:18.824229 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept: application/json Sep 21 12:38:18.824229 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept-Encoding: identity Sep 21 12:38:18.824229 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Connection: close Sep 21 12:38:18.824229 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Length: 0 Sep 21 12:38:18.824229 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Type: application/json Sep 21 12:38:18.824229 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Host: 10.222.0.71 Sep 21 12:38:18.824229 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Openstack-System-Scope: None Sep 21 12:38:18.824229 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: User-Agent: python-urllib3/1.26.12 Sep 21 12:38:18.824229 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Auth-Token: gAAAAABjKwWyzLIE3lVaLBIGUhHX2mU1hQ0dCHfcuG7nVD1MUUZ1g3yAjSQ6cXgCvH7A11IceEAYpDkvEcPdC86Wds6tCw1KOeTopPX_GPYaBSJz6wjcl7wJqgP7tfvbtIYF1_usBGHTYHAaJbLJEO9DOqBvT5S-nDXk0P679QeeyxUMwkxUQC4 Sep 21 12:38:18.824229 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Id: None Sep 21 12:38:18.824229 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Name: None Sep 21 12:38:18.824229 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Identity-Status: Confirmed Sep 21 12:38:18.824229 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Is-Admin-Project: True Sep 21 12:38:18.824229 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Id: default Sep 21 12:38:18.824229 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Name: Default Sep 21 12:38:18.824229 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Id: a66543d6a4cc405d936e54c420220792 Sep 21 12:38:18.824229 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1134807984 Sep 21 12:38:18.824229 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Role: reader,member Sep 21 12:38:18.824229 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Roles: reader,member Sep 21 12:38:18.826033 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/a66543d6a4cc405d936e54c420220792"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/a66543d6a4cc405d936e54c420220792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_a66543d6a4cc405d936e54c420220792", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/a66543d6a4cc405d936e54c420220792"}]}] Sep 21 12:38:18.826033 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1134807984 Sep 21 12:38:18.826033 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Id: a66543d6a4cc405d936e54c420220792 Sep 21 12:38:18.826033 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1134807984 Sep 21 12:38:18.826033 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User: tempest-VolumesSnapshotsTestJSON-1134807984-project Sep 21 12:38:18.826033 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Id: default Sep 21 12:38:18.826033 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Name: Default Sep 21 12:38:18.826033 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Id: ef9b2b64cc854b4ea048e0772baca5fa Sep 21 12:38:18.826033 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1134807984-project Sep 21 12:38:18.826033 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: method: Sep 21 12:38:18.826033 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: exception: Snapshot 20321f98-7b01-469a-a28b-f2543e754d9c could not be found. Sep 21 12:38:18.826033 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: action_args: {'id': '20321f98-7b01-469a-a28b-f2543e754d9c'} Sep 21 12:38:18.826033 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:38:18.827175 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:18.827175 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 21 12:38:18.827175 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 21 12:38:18.827175 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 21 12:38:18.827175 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 21 12:38:18.827175 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 21 12:38:18.827175 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 21 12:38:18.827175 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 21 12:38:18.827175 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 21 12:38:18.827175 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 21 12:38:18.827175 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 21 12:38:18.827175 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 21 12:38:18.827175 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 21 12:38:18.827175 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 21 12:38:18.827175 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 21 12:38:18.827175 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 20321f98-7b01-469a-a28b-f2543e754d9c could not be found. (HTTP 404) (Request-ID: req-262a2d5a-87c1-4c5f-92f8-e054c9015437) Sep 21 12:38:18.827175 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:18.827175 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:38:18.828488 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:18.828488 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:18.828488 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 21 12:38:18.828488 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 21 12:38:18.828488 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 21 12:38:18.828488 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 21 12:38:18.828488 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 21 12:38:18.828488 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 21 12:38:18.828488 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 21 12:38:18.828488 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 21 12:38:18.828488 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 21 12:38:18.828488 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 21 12:38:18.828488 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 21 12:38:18.828488 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 21 12:38:18.828488 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 21 12:38:18.828488 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 21 12:38:18.828488 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 21 12:38:18.828488 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 21 12:38:18.828488 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 21 12:38:18.829756 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 21 12:38:18.829756 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 21 12:38:18.829756 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 21 12:38:18.829756 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 21 12:38:18.829756 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 21 12:38:18.829756 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 20321f98-7b01-469a-a28b-f2543e754d9c could not be found. Sep 21 12:38:18.829756 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:18.829756 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:38:18.829756 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:18.829756 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:18.829756 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:38:18.829756 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:38:18.829756 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:38:18.829756 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:38:18.829756 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 21 12:38:18.829756 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 21 12:38:18.829756 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:38:18.829756 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:38:18.829756 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 21 12:38:18.829756 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:38:18.831107 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 20321f98-7b01-469a-a28b-f2543e754d9c could not be found. Sep 21 12:38:18.831107 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:18.831107 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:38:18.831107 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:18.831107 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:18.831107 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:38:18.831107 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:38:18.831107 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:38:18.831107 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:38:18.831107 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 20321f98-7b01-469a-a28b-f2543e754d9c could not be found. Sep 21 12:38:18.831107 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:18.831107 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-92aa6a21-b061-4a8a-a173-37fd08d93d47 tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] Returning 404 to user: Snapshot 20321f98-7b01-469a-a28b-f2543e754d9c could not be found. {{(pid=120463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:38:18.831107 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-92aa6a21-b061-4a8a-a173-37fd08d93d47 tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/20321f98-7b01-469a-a28b-f2543e754d9c" status: 404 len: 111 microversion: 2.1 time: 0.033541 Sep 21 12:38:18.832053 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 583/1180] 10.222.0.71 () {58 vars in 1251 bytes} [Wed Sep 21 12:38:18 2022] GET /compute/v2.1/os-snapshots/20321f98-7b01-469a-a28b-f2543e754d9c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:38:18.835197 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-7307bb16-4d87-4728-9439-24960e665de6 tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] Calling method '.version_select at 0x7fe4cc65aee0>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:38:18.904114 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-7307bb16-4d87-4728-9439-24960e665de6 tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] 10.222.0.71 "DELETE /compute/v2.1/os-volumes/cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9" status: 202 len: 0 microversion: 2.1 time: 0.073518 Sep 21 12:38:18.906828 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 598/1181] 10.222.0.71 () {58 vars in 1248 bytes} [Wed Sep 21 12:38:18 2022] DELETE /compute/v2.1/os-volumes/cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 12:38:18.913547 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-4a96c42e-6550-4789-bcd1-f1d69ea9c9df tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] Calling method '.version_select at 0x7fe4c8c83c10>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:38:18.961311 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-4a96c42e-6550-4789-bcd1-f1d69ea9c9df tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9" status: 200 len: 345 microversion: 2.1 time: 0.052209 Sep 21 12:38:18.967262 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 584/1182] 10.222.0.71 () {58 vars in 1245 bytes} [Wed Sep 21 12:38:18 2022] GET /compute/v2.1/os-volumes/cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:38:19.977698 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-ec775a71-de68-420c-8b7f-51e849fa42cb tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] Calling method '.version_select at 0x7fe4cc62c820>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:38:20.007046 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.wsgi [None req-ec775a71-de68-420c-8b7f-51e849fa42cb tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] HTTP exception thrown: Volume cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9 could not be found. Sep 21 12:38:20.009080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-ec775a71-de68-420c-8b7f-51e849fa42cb tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] Request method failure captured: Sep 21 12:38:20.009080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: request: GET /compute/v2.1/os-volumes/cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9 HTTP/1.1 Sep 21 12:38:20.009080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept: application/json Sep 21 12:38:20.009080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept-Encoding: identity Sep 21 12:38:20.009080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Connection: close Sep 21 12:38:20.009080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Length: 0 Sep 21 12:38:20.009080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Type: application/json Sep 21 12:38:20.009080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Host: 10.222.0.71 Sep 21 12:38:20.009080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Openstack-System-Scope: None Sep 21 12:38:20.009080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: User-Agent: python-urllib3/1.26.12 Sep 21 12:38:20.009080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Auth-Token: gAAAAABjKwWyzLIE3lVaLBIGUhHX2mU1hQ0dCHfcuG7nVD1MUUZ1g3yAjSQ6cXgCvH7A11IceEAYpDkvEcPdC86Wds6tCw1KOeTopPX_GPYaBSJz6wjcl7wJqgP7tfvbtIYF1_usBGHTYHAaJbLJEO9DOqBvT5S-nDXk0P679QeeyxUMwkxUQC4 Sep 21 12:38:20.009080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Id: None Sep 21 12:38:20.009080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Name: None Sep 21 12:38:20.009080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Identity-Status: Confirmed Sep 21 12:38:20.009080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Is-Admin-Project: True Sep 21 12:38:20.009080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Id: default Sep 21 12:38:20.009080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Name: Default Sep 21 12:38:20.009080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Id: a66543d6a4cc405d936e54c420220792 Sep 21 12:38:20.009080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1134807984 Sep 21 12:38:20.009080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Role: reader,member Sep 21 12:38:20.009080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Roles: reader,member Sep 21 12:38:20.010809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/a66543d6a4cc405d936e54c420220792"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/a66543d6a4cc405d936e54c420220792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_a66543d6a4cc405d936e54c420220792", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/a66543d6a4cc405d936e54c420220792"}]}] Sep 21 12:38:20.010809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1134807984 Sep 21 12:38:20.010809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Id: a66543d6a4cc405d936e54c420220792 Sep 21 12:38:20.010809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1134807984 Sep 21 12:38:20.010809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User: tempest-VolumesSnapshotsTestJSON-1134807984-project Sep 21 12:38:20.010809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Id: default Sep 21 12:38:20.010809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Name: Default Sep 21 12:38:20.010809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Id: ef9b2b64cc854b4ea048e0772baca5fa Sep 21 12:38:20.010809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1134807984-project Sep 21 12:38:20.010809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: method: Sep 21 12:38:20.010809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: exception: Volume cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9 could not be found. Sep 21 12:38:20.010809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: action_args: {'id': 'cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9'} Sep 21 12:38:20.010809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:38:20.011886 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:20.011886 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 21 12:38:20.011886 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 21 12:38:20.011886 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 21 12:38:20.011886 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 21 12:38:20.011886 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 21 12:38:20.011886 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 21 12:38:20.011886 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 21 12:38:20.011886 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 21 12:38:20.011886 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 21 12:38:20.011886 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 21 12:38:20.011886 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 21 12:38:20.011886 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 21 12:38:20.011886 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 21 12:38:20.011886 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 21 12:38:20.011886 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9 could not be found. (HTTP 404) (Request-ID: req-07ca9533-ec5c-4f6e-95a5-42ef5c5ceb85) Sep 21 12:38:20.011886 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:38:20.011886 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:38:20.011886 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:38:20.013390 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:20.013390 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 21 12:38:20.013390 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 21 12:38:20.013390 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 21 12:38:20.013390 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 21 12:38:20.013390 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 21 12:38:20.013390 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 21 12:38:20.013390 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 21 12:38:20.013390 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 21 12:38:20.013390 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 21 12:38:20.013390 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 21 12:38:20.013390 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 21 12:38:20.013390 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 21 12:38:20.013390 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 21 12:38:20.013390 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 21 12:38:20.013390 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 21 12:38:20.013390 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 21 12:38:20.013390 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 21 12:38:20.013390 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 21 12:38:20.015081 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 21 12:38:20.015081 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 21 12:38:20.015081 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 21 12:38:20.015081 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 21 12:38:20.015081 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9 could not be found. Sep 21 12:38:20.015081 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:38:20.015081 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:38:20.015081 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:38:20.015081 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:20.015081 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:38:20.015081 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:38:20.015081 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:38:20.015081 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:38:20.015081 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 21 12:38:20.015081 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 21 12:38:20.015081 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:38:20.015081 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:38:20.015081 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 21 12:38:20.015081 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:38:20.016790 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9 could not be found. Sep 21 12:38:20.016790 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:38:20.016790 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:38:20.016790 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:38:20.016790 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:20.016790 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:38:20.016790 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:38:20.016790 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:38:20.016790 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:38:20.016790 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9 could not be found. Sep 21 12:38:20.016790 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:38:20.016790 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-ec775a71-de68-420c-8b7f-51e849fa42cb tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] Returning 404 to user: Volume cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9 could not be found. {{(pid=120462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:38:20.016790 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-ec775a71-de68-420c-8b7f-51e849fa42cb tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9" status: 404 len: 109 microversion: 2.1 time: 0.037769 Sep 21 12:38:20.016790 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 599/1183] 10.222.0.71 () {58 vars in 1245 bytes} [Wed Sep 21 12:38:19 2022] GET /compute/v2.1/os-volumes/cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:38:20.025848 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-a6d6de18-4a65-42bd-8fe2-11105616af26 tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] Calling method '.version_select at 0x7fe4c8dd9790>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:38:20.057055 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.wsgi [None req-a6d6de18-4a65-42bd-8fe2-11105616af26 tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] HTTP exception thrown: Volume cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9 could not be found. Sep 21 12:38:20.061393 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-a6d6de18-4a65-42bd-8fe2-11105616af26 tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] Request method failure captured: Sep 21 12:38:20.061393 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: request: DELETE /compute/v2.1/os-volumes/cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9 HTTP/1.1 Sep 21 12:38:20.061393 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept: application/json Sep 21 12:38:20.061393 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept-Encoding: identity Sep 21 12:38:20.061393 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Connection: close Sep 21 12:38:20.061393 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Length: 0 Sep 21 12:38:20.061393 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Type: application/json Sep 21 12:38:20.061393 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Host: 10.222.0.71 Sep 21 12:38:20.061393 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Openstack-System-Scope: None Sep 21 12:38:20.061393 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: User-Agent: python-urllib3/1.26.12 Sep 21 12:38:20.061393 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Auth-Token: gAAAAABjKwWyzLIE3lVaLBIGUhHX2mU1hQ0dCHfcuG7nVD1MUUZ1g3yAjSQ6cXgCvH7A11IceEAYpDkvEcPdC86Wds6tCw1KOeTopPX_GPYaBSJz6wjcl7wJqgP7tfvbtIYF1_usBGHTYHAaJbLJEO9DOqBvT5S-nDXk0P679QeeyxUMwkxUQC4 Sep 21 12:38:20.061393 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Id: None Sep 21 12:38:20.061393 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Name: None Sep 21 12:38:20.061393 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Identity-Status: Confirmed Sep 21 12:38:20.061393 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Is-Admin-Project: True Sep 21 12:38:20.061393 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Id: default Sep 21 12:38:20.061393 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Name: Default Sep 21 12:38:20.061393 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Id: a66543d6a4cc405d936e54c420220792 Sep 21 12:38:20.061393 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1134807984 Sep 21 12:38:20.061393 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Role: reader,member Sep 21 12:38:20.061393 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Roles: reader,member Sep 21 12:38:20.063092 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/a66543d6a4cc405d936e54c420220792"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/a66543d6a4cc405d936e54c420220792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_a66543d6a4cc405d936e54c420220792", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/a66543d6a4cc405d936e54c420220792"}]}] Sep 21 12:38:20.063092 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1134807984 Sep 21 12:38:20.063092 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Id: a66543d6a4cc405d936e54c420220792 Sep 21 12:38:20.063092 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1134807984 Sep 21 12:38:20.063092 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User: tempest-VolumesSnapshotsTestJSON-1134807984-project Sep 21 12:38:20.063092 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Id: default Sep 21 12:38:20.063092 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Name: Default Sep 21 12:38:20.063092 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Id: ef9b2b64cc854b4ea048e0772baca5fa Sep 21 12:38:20.063092 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1134807984-project Sep 21 12:38:20.063092 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: method: Sep 21 12:38:20.063092 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: exception: Volume cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9 could not be found. Sep 21 12:38:20.063092 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: action_args: {'id': 'cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9'} Sep 21 12:38:20.063092 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:38:20.064391 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:20.064391 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 21 12:38:20.064391 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 21 12:38:20.064391 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 21 12:38:20.064391 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 21 12:38:20.064391 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 21 12:38:20.064391 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 21 12:38:20.064391 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 21 12:38:20.064391 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 21 12:38:20.064391 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 21 12:38:20.064391 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 21 12:38:20.064391 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 21 12:38:20.064391 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 21 12:38:20.064391 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 21 12:38:20.064391 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 21 12:38:20.064391 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9 could not be found. (HTTP 404) (Request-ID: req-f3427ca2-8344-4be4-b146-ca1c606a041e) Sep 21 12:38:20.064391 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:20.064391 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:38:20.064391 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:20.065824 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:20.065824 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 21 12:38:20.065824 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 21 12:38:20.065824 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 21 12:38:20.065824 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 21 12:38:20.065824 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 21 12:38:20.065824 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 21 12:38:20.065824 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 21 12:38:20.065824 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 21 12:38:20.065824 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 21 12:38:20.065824 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 21 12:38:20.065824 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 21 12:38:20.065824 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 21 12:38:20.065824 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 21 12:38:20.065824 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 21 12:38:20.065824 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 21 12:38:20.065824 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 21 12:38:20.065824 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 21 12:38:20.065824 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 21 12:38:20.067223 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 21 12:38:20.067223 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 21 12:38:20.067223 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 21 12:38:20.067223 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 21 12:38:20.067223 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9 could not be found. Sep 21 12:38:20.067223 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:20.067223 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:38:20.067223 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:20.067223 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:20.067223 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:38:20.067223 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:38:20.067223 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:38:20.067223 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:38:20.067223 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 21 12:38:20.067223 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 21 12:38:20.067223 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:38:20.067223 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:38:20.067223 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 21 12:38:20.067223 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:38:20.068843 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9 could not be found. Sep 21 12:38:20.068843 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:20.068843 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:38:20.068843 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:20.068843 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:20.068843 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:38:20.068843 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:38:20.068843 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:38:20.068843 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:38:20.068843 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9 could not be found. Sep 21 12:38:20.068843 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:38:20.068843 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-a6d6de18-4a65-42bd-8fe2-11105616af26 tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] Returning 404 to user: Volume cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9 could not be found. {{(pid=120463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:38:20.068843 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-a6d6de18-4a65-42bd-8fe2-11105616af26 tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] 10.222.0.71 "DELETE /compute/v2.1/os-volumes/cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9" status: 404 len: 109 microversion: 2.1 time: 0.041435 Sep 21 12:38:20.069975 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 585/1184] 10.222.0.71 () {58 vars in 1248 bytes} [Wed Sep 21 12:38:20 2022] DELETE /compute/v2.1/os-volumes/cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:38:20.071525 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-3a3e5567-ce50-4213-9547-a7154865d5b1 tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] Calling method '.version_select at 0x7fe4cc61c430>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:38:20.100773 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.wsgi [None req-3a3e5567-ce50-4213-9547-a7154865d5b1 tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] HTTP exception thrown: Volume cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9 could not be found. Sep 21 12:38:20.102789 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-3a3e5567-ce50-4213-9547-a7154865d5b1 tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] Request method failure captured: Sep 21 12:38:20.102789 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: request: GET /compute/v2.1/os-volumes/cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9 HTTP/1.1 Sep 21 12:38:20.102789 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept: application/json Sep 21 12:38:20.102789 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept-Encoding: identity Sep 21 12:38:20.102789 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Connection: close Sep 21 12:38:20.102789 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Length: 0 Sep 21 12:38:20.102789 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Type: application/json Sep 21 12:38:20.102789 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Host: 10.222.0.71 Sep 21 12:38:20.102789 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Openstack-System-Scope: None Sep 21 12:38:20.102789 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: User-Agent: python-urllib3/1.26.12 Sep 21 12:38:20.102789 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Auth-Token: gAAAAABjKwWyzLIE3lVaLBIGUhHX2mU1hQ0dCHfcuG7nVD1MUUZ1g3yAjSQ6cXgCvH7A11IceEAYpDkvEcPdC86Wds6tCw1KOeTopPX_GPYaBSJz6wjcl7wJqgP7tfvbtIYF1_usBGHTYHAaJbLJEO9DOqBvT5S-nDXk0P679QeeyxUMwkxUQC4 Sep 21 12:38:20.102789 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Id: None Sep 21 12:38:20.102789 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Name: None Sep 21 12:38:20.102789 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Identity-Status: Confirmed Sep 21 12:38:20.102789 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Is-Admin-Project: True Sep 21 12:38:20.102789 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Id: default Sep 21 12:38:20.102789 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Name: Default Sep 21 12:38:20.102789 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Id: a66543d6a4cc405d936e54c420220792 Sep 21 12:38:20.102789 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1134807984 Sep 21 12:38:20.102789 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Role: reader,member Sep 21 12:38:20.102789 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Roles: reader,member Sep 21 12:38:20.104506 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/a66543d6a4cc405d936e54c420220792"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/a66543d6a4cc405d936e54c420220792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_a66543d6a4cc405d936e54c420220792", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/a66543d6a4cc405d936e54c420220792"}]}] Sep 21 12:38:20.104506 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1134807984 Sep 21 12:38:20.104506 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Id: a66543d6a4cc405d936e54c420220792 Sep 21 12:38:20.104506 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1134807984 Sep 21 12:38:20.104506 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User: tempest-VolumesSnapshotsTestJSON-1134807984-project Sep 21 12:38:20.104506 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Id: default Sep 21 12:38:20.104506 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Name: Default Sep 21 12:38:20.104506 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Id: ef9b2b64cc854b4ea048e0772baca5fa Sep 21 12:38:20.104506 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1134807984-project Sep 21 12:38:20.104506 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: method: Sep 21 12:38:20.104506 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: exception: Volume cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9 could not be found. Sep 21 12:38:20.104506 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: action_args: {'id': 'cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9'} Sep 21 12:38:20.104506 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:38:20.105544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:20.105544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 21 12:38:20.105544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 21 12:38:20.105544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 21 12:38:20.105544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 21 12:38:20.105544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 21 12:38:20.105544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 21 12:38:20.105544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 21 12:38:20.105544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 21 12:38:20.105544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 21 12:38:20.105544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 21 12:38:20.105544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 21 12:38:20.105544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 21 12:38:20.105544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 21 12:38:20.105544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 21 12:38:20.105544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9 could not be found. (HTTP 404) (Request-ID: req-3bb86211-0694-4d88-b5cc-3ceeeffacd3e) Sep 21 12:38:20.105544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:38:20.105544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:38:20.105544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:38:20.106981 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:20.106981 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 21 12:38:20.106981 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 21 12:38:20.106981 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 21 12:38:20.106981 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 21 12:38:20.106981 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 21 12:38:20.106981 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 21 12:38:20.106981 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 21 12:38:20.106981 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 21 12:38:20.106981 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 21 12:38:20.106981 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 21 12:38:20.106981 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 21 12:38:20.106981 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 21 12:38:20.106981 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 21 12:38:20.106981 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 21 12:38:20.106981 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 21 12:38:20.106981 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 21 12:38:20.106981 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 21 12:38:20.106981 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 21 12:38:20.108532 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 21 12:38:20.108532 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 21 12:38:20.108532 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 21 12:38:20.108532 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 21 12:38:20.108532 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9 could not be found. Sep 21 12:38:20.108532 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:38:20.108532 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:38:20.108532 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:38:20.108532 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:20.108532 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:38:20.108532 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:38:20.108532 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:38:20.108532 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:38:20.108532 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 21 12:38:20.108532 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 21 12:38:20.108532 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:38:20.108532 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:38:20.108532 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 21 12:38:20.108532 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:38:20.110026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9 could not be found. Sep 21 12:38:20.110026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:38:20.110026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:38:20.110026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:38:20.110026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:38:20.110026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:38:20.110026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:38:20.110026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:38:20.110026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:38:20.110026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9 could not be found. Sep 21 12:38:20.110026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:38:20.110026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-3a3e5567-ce50-4213-9547-a7154865d5b1 tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] Returning 404 to user: Volume cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9 could not be found. {{(pid=120462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:38:20.110026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-3a3e5567-ce50-4213-9547-a7154865d5b1 tempest-VolumesSnapshotsTestJSON-1134807984 tempest-VolumesSnapshotsTestJSON-1134807984-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9" status: 404 len: 109 microversion: 2.1 time: 0.036520 Sep 21 12:38:20.110026 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 600/1185] 10.222.0.71 () {58 vars in 1245 bytes} [Wed Sep 21 12:38:20 2022] GET /compute/v2.1/os-volumes/cb68099e-e5a2-4c6a-8328-baf8c0e1cdc9 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:39:06.343020 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-cdfa904e-ff50-44c4-8d72-22f6d854a5e7 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1698402595", "imageRef": "1e3a8d95-6338-499c-af91-e3d1345af950", "flavorRef": "452", "networks": [{"uuid": "78a46204-c7f5-4031-b525-9dd641483b1c"}]}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:39:06.395509 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.network.neutron [None req-cdfa904e-ff50-44c4-8d72-22f6d854a5e7 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] validate_networks() for [('78a46204-c7f5-4031-b525-9dd641483b1c', None, None, None, None, None)] {{(pid=120463) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 12:39:06.751790 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-cdfa904e-ff50-44c4-8d72-22f6d854a5e7 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Flavor limits 0:0:0 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 12:39:06.752218 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-cdfa904e-ff50-44c4-8d72-22f6d854a5e7 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Image limits 0:0:0 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 12:39:06.752689 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-cdfa904e-ff50-44c4-8d72-22f6d854a5e7 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Flavor pref 0:0:0 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 12:39:06.753104 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-cdfa904e-ff50-44c4-8d72-22f6d854a5e7 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Image pref 0:0:0 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 12:39:06.753510 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-cdfa904e-ff50-44c4-8d72-22f6d854a5e7 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 12:39:06.762358 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cdfa904e-ff50-44c4-8d72-22f6d854a5e7 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:06.762836 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cdfa904e-ff50-44c4-8d72-22f6d854a5e7 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:06.763269 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cdfa904e-ff50-44c4-8d72-22f6d854a5e7 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:06.764453 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cdfa904e-ff50-44c4-8d72-22f6d854a5e7 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:06.764453 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cdfa904e-ff50-44c4-8d72-22f6d854a5e7 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:06.764871 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-cdfa904e-ff50-44c4-8d72-22f6d854a5e7 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:06.781777 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.quota [None req-cdfa904e-ff50-44c4-8d72-22f6d854a5e7 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Getting quotas for project c274a3c4e6954affbfe3d07e849d64b7. Resources: {'instances', 'ram', 'cores'} {{(pid=120463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 12:39:06.785667 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.quota [None req-cdfa904e-ff50-44c4-8d72-22f6d854a5e7 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Getting quotas for user d757e6ac07be4c79868adee5777dc461 and project c274a3c4e6954affbfe3d07e849d64b7. Resources: {'instances', 'ram', 'cores'} {{(pid=120463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 12:39:06.797009 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-cdfa904e-ff50-44c4-8d72-22f6d854a5e7 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Going to run 1 instances... {{(pid=120463) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 12:39:06.799324 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-cdfa904e-ff50-44c4-8d72-22f6d854a5e7 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: ad1c39f2-abf9-471c-bc00-3e667301e142] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e3a8d95-6338-499c-af91-e3d1345af950',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 12:39:06.847447 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-cdfa904e-ff50-44c4-8d72-22f6d854a5e7 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.509361 Sep 21 12:39:06.848134 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 586/1186] 10.222.0.71 () {60 vars in 1147 bytes} [Wed Sep 21 12:39:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 21 12:39:06.860780 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-9f59e3de-36fa-4c78-a0d9-4ca37776ff62 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:39:06.861576 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-9f59e3de-36fa-4c78-a0d9-4ca37776ff62 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: ad1c39f2-abf9-471c-bc00-3e667301e142] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:39:06.918501 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-9f59e3de-36fa-4c78-a0d9-4ca37776ff62 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd757e6ac07be4c79868adee5777dc461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c274a3c4e6954affbfe3d07e849d64b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:39:06.926073 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-9f59e3de-36fa-4c78-a0d9-4ca37776ff62 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142" status: 200 len: 1219 microversion: 2.1 time: 0.070301 Sep 21 12:39:06.926632 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 601/1187] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:39:06 2022] GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:39:07.949166 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-dcf1ee1e-48fe-4732-9e5f-5b0916a631b5 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:39:07.949781 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-dcf1ee1e-48fe-4732-9e5f-5b0916a631b5 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: ad1c39f2-abf9-471c-bc00-3e667301e142] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:39:08.001604 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-dcf1ee1e-48fe-4732-9e5f-5b0916a631b5 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd757e6ac07be4c79868adee5777dc461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c274a3c4e6954affbfe3d07e849d64b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:39:08.007984 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-dcf1ee1e-48fe-4732-9e5f-5b0916a631b5 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142" status: 200 len: 1219 microversion: 2.1 time: 0.063066 Sep 21 12:39:08.008553 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 587/1188] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:39:07 2022] GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142 => generated 1219 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:39:09.030227 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-209b9922-1633-4f85-bbd3-b16fdaf2f58c tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:39:09.030918 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-209b9922-1633-4f85-bbd3-b16fdaf2f58c tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: ad1c39f2-abf9-471c-bc00-3e667301e142] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:39:09.085392 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-209b9922-1633-4f85-bbd3-b16fdaf2f58c tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd757e6ac07be4c79868adee5777dc461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c274a3c4e6954affbfe3d07e849d64b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:39:09.092489 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-209b9922-1633-4f85-bbd3-b16fdaf2f58c tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142" status: 200 len: 1219 microversion: 2.1 time: 0.066184 Sep 21 12:39:09.093055 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 602/1189] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:39:09 2022] GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:39:10.118161 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-4e16094e-4b7a-49f8-8faa-1d84e4f911af tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:39:10.118766 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-4e16094e-4b7a-49f8-8faa-1d84e4f911af tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: ad1c39f2-abf9-471c-bc00-3e667301e142] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:39:10.170911 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-4e16094e-4b7a-49f8-8faa-1d84e4f911af tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd757e6ac07be4c79868adee5777dc461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c274a3c4e6954affbfe3d07e849d64b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:39:10.179453 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-4e16094e-4b7a-49f8-8faa-1d84e4f911af tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142" status: 200 len: 1219 microversion: 2.1 time: 0.064982 Sep 21 12:39:10.180127 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 588/1190] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:39:10 2022] GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142 => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:39:11.203003 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-92b88ddc-9efc-4925-9206-fbb75cccc28a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:39:11.203631 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-92b88ddc-9efc-4925-9206-fbb75cccc28a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: ad1c39f2-abf9-471c-bc00-3e667301e142] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:39:11.210480 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-92b88ddc-9efc-4925-9206-fbb75cccc28a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:11.210959 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-92b88ddc-9efc-4925-9206-fbb75cccc28a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:11.211903 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-92b88ddc-9efc-4925-9206-fbb75cccc28a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:11.212582 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-92b88ddc-9efc-4925-9206-fbb75cccc28a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:11.213031 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-92b88ddc-9efc-4925-9206-fbb75cccc28a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:11.213448 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-92b88ddc-9efc-4925-9206-fbb75cccc28a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:11.272435 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-92b88ddc-9efc-4925-9206-fbb75cccc28a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd757e6ac07be4c79868adee5777dc461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c274a3c4e6954affbfe3d07e849d64b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:39:11.280585 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-92b88ddc-9efc-4925-9206-fbb75cccc28a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142" status: 200 len: 1223 microversion: 2.1 time: 0.081475 Sep 21 12:39:11.281158 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 603/1191] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:39:11 2022] GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:39:12.304454 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-e308f532-d506-4046-9b1f-64c16aaff90a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:39:12.305604 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-e308f532-d506-4046-9b1f-64c16aaff90a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: ad1c39f2-abf9-471c-bc00-3e667301e142] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:39:12.313329 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e308f532-d506-4046-9b1f-64c16aaff90a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:12.313833 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e308f532-d506-4046-9b1f-64c16aaff90a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:12.314248 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e308f532-d506-4046-9b1f-64c16aaff90a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:12.314953 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e308f532-d506-4046-9b1f-64c16aaff90a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:12.315415 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e308f532-d506-4046-9b1f-64c16aaff90a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:12.315879 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-e308f532-d506-4046-9b1f-64c16aaff90a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:12.380864 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-e308f532-d506-4046-9b1f-64c16aaff90a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd757e6ac07be4c79868adee5777dc461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c274a3c4e6954affbfe3d07e849d64b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:39:12.394115 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-e308f532-d506-4046-9b1f-64c16aaff90a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142" status: 200 len: 1277 microversion: 2.1 time: 0.093372 Sep 21 12:39:12.394615 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 589/1192] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:39:12 2022] GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142 => generated 1277 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:39:13.406634 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-220f2b01-b514-4efc-b9e6-83b630450cb3 req-50817f7b-14ce-4cdf-bc6f-00f78ad0049a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad1c39f2-abf9-471c-bc00-3e667301e142", "tag": "f63acfcf-38af-4fbd-885a-51ebe549bf21"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:39:13.418662 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-08c60441-ac55-4256-ac47-15e3fe65b8d6 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:39:13.420089 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-220f2b01-b514-4efc-b9e6-83b630450cb3 req-50817f7b-14ce-4cdf-bc6f-00f78ad0049a service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:13.420472 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-08c60441-ac55-4256-ac47-15e3fe65b8d6 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: ad1c39f2-abf9-471c-bc00-3e667301e142] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:39:13.420669 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-220f2b01-b514-4efc-b9e6-83b630450cb3 req-50817f7b-14ce-4cdf-bc6f-00f78ad0049a service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:13.421412 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-220f2b01-b514-4efc-b9e6-83b630450cb3 req-50817f7b-14ce-4cdf-bc6f-00f78ad0049a service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:13.435295 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-220f2b01-b514-4efc-b9e6-83b630450cb3 req-50817f7b-14ce-4cdf-bc6f-00f78ad0049a service nova] Creating event network-changed:f63acfcf-38af-4fbd-885a-51ebe549bf21 for instance ad1c39f2-abf9-471c-bc00-3e667301e142 on hv-cinder-85867 Sep 21 12:39:13.436089 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-08c60441-ac55-4256-ac47-15e3fe65b8d6 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:13.436852 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-08c60441-ac55-4256-ac47-15e3fe65b8d6 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:13.437526 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-08c60441-ac55-4256-ac47-15e3fe65b8d6 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:13.438626 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-08c60441-ac55-4256-ac47-15e3fe65b8d6 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:13.439339 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-08c60441-ac55-4256-ac47-15e3fe65b8d6 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:13.440282 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-08c60441-ac55-4256-ac47-15e3fe65b8d6 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:13.441676 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-220f2b01-b514-4efc-b9e6-83b630450cb3 req-50817f7b-14ce-4cdf-bc6f-00f78ad0049a service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040719 Sep 21 12:39:13.442402 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 604/1193] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:39:13.577594 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-08c60441-ac55-4256-ac47-15e3fe65b8d6 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd757e6ac07be4c79868adee5777dc461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c274a3c4e6954affbfe3d07e849d64b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:39:13.585262 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-08c60441-ac55-4256-ac47-15e3fe65b8d6 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142" status: 200 len: 1319 microversion: 2.1 time: 0.171437 Sep 21 12:39:13.585837 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 590/1194] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:39:13 2022] GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:39:14.608523 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-d0c8e2c2-3bdd-4d0a-9c91-4f5ad08e628d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:39:14.609223 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-d0c8e2c2-3bdd-4d0a-9c91-4f5ad08e628d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: ad1c39f2-abf9-471c-bc00-3e667301e142] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:39:14.615399 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d0c8e2c2-3bdd-4d0a-9c91-4f5ad08e628d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:14.616021 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d0c8e2c2-3bdd-4d0a-9c91-4f5ad08e628d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:14.616346 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d0c8e2c2-3bdd-4d0a-9c91-4f5ad08e628d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:14.617048 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d0c8e2c2-3bdd-4d0a-9c91-4f5ad08e628d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:14.617513 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d0c8e2c2-3bdd-4d0a-9c91-4f5ad08e628d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:14.617939 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d0c8e2c2-3bdd-4d0a-9c91-4f5ad08e628d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:14.746367 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-d0c8e2c2-3bdd-4d0a-9c91-4f5ad08e628d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd757e6ac07be4c79868adee5777dc461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c274a3c4e6954affbfe3d07e849d64b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:39:14.754170 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-d0c8e2c2-3bdd-4d0a-9c91-4f5ad08e628d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142" status: 200 len: 1319 microversion: 2.1 time: 0.150427 Sep 21 12:39:14.754735 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 605/1195] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:39:14 2022] GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:39:15.778137 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-297e5f7f-8ffe-4bc8-b0c2-8db19acf0b9d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:39:15.778784 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-297e5f7f-8ffe-4bc8-b0c2-8db19acf0b9d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: ad1c39f2-abf9-471c-bc00-3e667301e142] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:39:15.785264 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-297e5f7f-8ffe-4bc8-b0c2-8db19acf0b9d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:15.785750 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-297e5f7f-8ffe-4bc8-b0c2-8db19acf0b9d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:15.786194 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-297e5f7f-8ffe-4bc8-b0c2-8db19acf0b9d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:15.786888 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-297e5f7f-8ffe-4bc8-b0c2-8db19acf0b9d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:15.787348 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-297e5f7f-8ffe-4bc8-b0c2-8db19acf0b9d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:15.787813 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-297e5f7f-8ffe-4bc8-b0c2-8db19acf0b9d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:15.912435 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-297e5f7f-8ffe-4bc8-b0c2-8db19acf0b9d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd757e6ac07be4c79868adee5777dc461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c274a3c4e6954affbfe3d07e849d64b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:39:15.920757 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-297e5f7f-8ffe-4bc8-b0c2-8db19acf0b9d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142" status: 200 len: 1319 microversion: 2.1 time: 0.146941 Sep 21 12:39:15.921334 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 591/1196] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:39:15 2022] GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:39:16.943373 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-8e6053ce-1b29-4a50-99d1-a3269329aa23 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:39:16.944018 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-8e6053ce-1b29-4a50-99d1-a3269329aa23 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: ad1c39f2-abf9-471c-bc00-3e667301e142] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:39:16.950553 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8e6053ce-1b29-4a50-99d1-a3269329aa23 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:16.951034 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8e6053ce-1b29-4a50-99d1-a3269329aa23 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:16.951471 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8e6053ce-1b29-4a50-99d1-a3269329aa23 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:16.952198 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8e6053ce-1b29-4a50-99d1-a3269329aa23 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:16.952650 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8e6053ce-1b29-4a50-99d1-a3269329aa23 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:16.953079 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8e6053ce-1b29-4a50-99d1-a3269329aa23 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:17.079664 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-8e6053ce-1b29-4a50-99d1-a3269329aa23 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd757e6ac07be4c79868adee5777dc461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c274a3c4e6954affbfe3d07e849d64b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:39:17.087370 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-8e6053ce-1b29-4a50-99d1-a3269329aa23 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142" status: 200 len: 1319 microversion: 2.1 time: 0.147849 Sep 21 12:39:17.087970 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 606/1197] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:39:16 2022] GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:39:18.110385 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-8609a9a0-25c1-46c4-bb80-66512293dbb4 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:39:18.111004 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-8609a9a0-25c1-46c4-bb80-66512293dbb4 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: ad1c39f2-abf9-471c-bc00-3e667301e142] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:39:18.113003 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell0:SELECT=2 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:39:18.119636 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8609a9a0-25c1-46c4-bb80-66512293dbb4 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:18.120146 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8609a9a0-25c1-46c4-bb80-66512293dbb4 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:18.120591 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8609a9a0-25c1-46c4-bb80-66512293dbb4 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:18.121284 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8609a9a0-25c1-46c4-bb80-66512293dbb4 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:18.121924 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8609a9a0-25c1-46c4-bb80-66512293dbb4 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:18.122354 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-8609a9a0-25c1-46c4-bb80-66512293dbb4 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:18.257337 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-8609a9a0-25c1-46c4-bb80-66512293dbb4 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd757e6ac07be4c79868adee5777dc461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c274a3c4e6954affbfe3d07e849d64b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:39:18.266004 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-8609a9a0-25c1-46c4-bb80-66512293dbb4 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142" status: 200 len: 1319 microversion: 2.1 time: 0.159557 Sep 21 12:39:18.266575 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 592/1198] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:39:18 2022] GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:39:19.288796 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-51039fad-95e3-47ff-904c-2e99a95b3e36 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:39:19.289375 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-51039fad-95e3-47ff-904c-2e99a95b3e36 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: ad1c39f2-abf9-471c-bc00-3e667301e142] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:39:19.291748 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell0:SELECT=4 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:39:19.297363 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-51039fad-95e3-47ff-904c-2e99a95b3e36 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:19.297853 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-51039fad-95e3-47ff-904c-2e99a95b3e36 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:19.298296 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-51039fad-95e3-47ff-904c-2e99a95b3e36 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:19.299055 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-51039fad-95e3-47ff-904c-2e99a95b3e36 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:19.299514 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-51039fad-95e3-47ff-904c-2e99a95b3e36 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:19.299991 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-51039fad-95e3-47ff-904c-2e99a95b3e36 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:19.430616 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-51039fad-95e3-47ff-904c-2e99a95b3e36 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd757e6ac07be4c79868adee5777dc461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c274a3c4e6954affbfe3d07e849d64b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:39:19.438256 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-51039fad-95e3-47ff-904c-2e99a95b3e36 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142" status: 200 len: 1319 microversion: 2.1 time: 0.153436 Sep 21 12:39:19.438914 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 607/1199] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:39:19 2022] GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:39:20.177632 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-4d3fe7f7-738d-4165-896b-9490f8d4ac7c req-3232c2cb-8e3a-44b6-87b2-57fc9b394474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad1c39f2-abf9-471c-bc00-3e667301e142", "name": "network-vif-plugged", "status": "completed", "tag": "f63acfcf-38af-4fbd-885a-51ebe549bf21"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:39:20.183494 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell0:SELECT=10 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:39:20.189352 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-4d3fe7f7-738d-4165-896b-9490f8d4ac7c req-3232c2cb-8e3a-44b6-87b2-57fc9b394474 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:20.189837 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-4d3fe7f7-738d-4165-896b-9490f8d4ac7c req-3232c2cb-8e3a-44b6-87b2-57fc9b394474 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:20.190284 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-4d3fe7f7-738d-4165-896b-9490f8d4ac7c req-3232c2cb-8e3a-44b6-87b2-57fc9b394474 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:20.201421 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-4d3fe7f7-738d-4165-896b-9490f8d4ac7c req-3232c2cb-8e3a-44b6-87b2-57fc9b394474 service nova] Creating event network-vif-plugged:f63acfcf-38af-4fbd-885a-51ebe549bf21 for instance ad1c39f2-abf9-471c-bc00-3e667301e142 on hv-cinder-85867 Sep 21 12:39:20.206538 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-4d3fe7f7-738d-4165-896b-9490f8d4ac7c req-3232c2cb-8e3a-44b6-87b2-57fc9b394474 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032625 Sep 21 12:39:20.207459 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 593/1200] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:39:20.463208 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-0f716d12-92be-4397-862e-cb017c0edaea tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:39:20.463849 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-0f716d12-92be-4397-862e-cb017c0edaea tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: ad1c39f2-abf9-471c-bc00-3e667301e142] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:39:20.470530 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0f716d12-92be-4397-862e-cb017c0edaea tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:20.471011 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0f716d12-92be-4397-862e-cb017c0edaea tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:20.471447 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0f716d12-92be-4397-862e-cb017c0edaea tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:20.472174 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0f716d12-92be-4397-862e-cb017c0edaea tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:20.472629 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0f716d12-92be-4397-862e-cb017c0edaea tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:20.473053 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-0f716d12-92be-4397-862e-cb017c0edaea tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:20.602847 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-0f716d12-92be-4397-862e-cb017c0edaea tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd757e6ac07be4c79868adee5777dc461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c274a3c4e6954affbfe3d07e849d64b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:39:20.610563 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-0f716d12-92be-4397-862e-cb017c0edaea tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142" status: 200 len: 1319 microversion: 2.1 time: 0.151847 Sep 21 12:39:20.611129 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 608/1201] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:39:20 2022] GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:39:21.634268 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-dce26de3-4404-46db-9120-b585bdbaaa48 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:39:21.635000 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-dce26de3-4404-46db-9120-b585bdbaaa48 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: ad1c39f2-abf9-471c-bc00-3e667301e142] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:39:21.642205 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dce26de3-4404-46db-9120-b585bdbaaa48 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:21.642700 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dce26de3-4404-46db-9120-b585bdbaaa48 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:21.643152 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dce26de3-4404-46db-9120-b585bdbaaa48 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:21.645369 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dce26de3-4404-46db-9120-b585bdbaaa48 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:21.645839 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dce26de3-4404-46db-9120-b585bdbaaa48 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:21.646298 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-dce26de3-4404-46db-9120-b585bdbaaa48 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:21.780725 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-dce26de3-4404-46db-9120-b585bdbaaa48 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd757e6ac07be4c79868adee5777dc461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c274a3c4e6954affbfe3d07e849d64b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:39:21.788483 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-dce26de3-4404-46db-9120-b585bdbaaa48 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142" status: 200 len: 1319 microversion: 2.1 time: 0.159300 Sep 21 12:39:21.789140 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 594/1202] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:39:21 2022] GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:39:22.812163 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-95784eda-7067-4fc8-9842-20e40cb3b71a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:39:22.812760 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-95784eda-7067-4fc8-9842-20e40cb3b71a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: ad1c39f2-abf9-471c-bc00-3e667301e142] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:39:22.819164 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-95784eda-7067-4fc8-9842-20e40cb3b71a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:22.819641 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-95784eda-7067-4fc8-9842-20e40cb3b71a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:22.820119 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-95784eda-7067-4fc8-9842-20e40cb3b71a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:22.821450 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-95784eda-7067-4fc8-9842-20e40cb3b71a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:22.821904 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-95784eda-7067-4fc8-9842-20e40cb3b71a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:22.822330 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-95784eda-7067-4fc8-9842-20e40cb3b71a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:22.949400 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-95784eda-7067-4fc8-9842-20e40cb3b71a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd757e6ac07be4c79868adee5777dc461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c274a3c4e6954affbfe3d07e849d64b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:39:22.957131 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-95784eda-7067-4fc8-9842-20e40cb3b71a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142" status: 200 len: 1506 microversion: 2.1 time: 0.148842 Sep 21 12:39:22.957703 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 609/1203] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:39:22 2022] GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142 => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:39:43.440479 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-9f131312-2028-4ea1-90c3-80455706ab03 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e14084c-68cc-49a2-939a-9f7c9907499d", "device": "/dev/sdb"}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:39:43.443342 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-9f131312-2028-4ea1-90c3-80455706ab03 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: ad1c39f2-abf9-471c-bc00-3e667301e142] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:39:43.445936 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 21 12:39:43.446113 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Wed Sep 21 12:39:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142/os-volume_attachments (ip 10.222.0.71) !!! Sep 21 12:39:43.447395 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:39:43.448258 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=34 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:39:43.456787 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9f131312-2028-4ea1-90c3-80455706ab03 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:43.457282 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9f131312-2028-4ea1-90c3-80455706ab03 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:43.457740 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9f131312-2028-4ea1-90c3-80455706ab03 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:43.458437 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9f131312-2028-4ea1-90c3-80455706ab03 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:43.458895 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9f131312-2028-4ea1-90c3-80455706ab03 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:43.459325 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9f131312-2028-4ea1-90c3-80455706ab03 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:43.728322 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-9f131312-2028-4ea1-90c3-80455706ab03 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "POST /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291399 Sep 21 12:39:43.728981 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 595/1204] 10.222.0.71 () {60 vars in 1323 bytes} [Wed Sep 21 12:39:43 2022] POST /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:39:56.876831 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-609857b7-569e-4762-8a25-a0a250d9fc2e req-ab52013b-c7b4-4630-914a-9cdeec9e6543 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75bac536-33c8-4759-b20e-616b74cc9911", "tag": "b59a24c4-8b22-46a9-9862-f49dd8712720"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:39:56.880306 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-5a76bdf9-c6db-4ae5-b0f8-35c755e9a320 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:39:56.880980 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-5a76bdf9-c6db-4ae5-b0f8-35c755e9a320 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 75bac536-33c8-4759-b20e-616b74cc9911] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:39:56.889084 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=2 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:39:56.889755 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:39:56.890943 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 21 12:39:56.892623 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_api:SELECT=22 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:39:56.893407 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=38 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:39:56.907785 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-609857b7-569e-4762-8a25-a0a250d9fc2e req-ab52013b-c7b4-4630-914a-9cdeec9e6543 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:56.908274 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-609857b7-569e-4762-8a25-a0a250d9fc2e req-ab52013b-c7b4-4630-914a-9cdeec9e6543 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:56.908706 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-609857b7-569e-4762-8a25-a0a250d9fc2e req-ab52013b-c7b4-4630-914a-9cdeec9e6543 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:56.918068 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5a76bdf9-c6db-4ae5-b0f8-35c755e9a320 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:56.918558 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5a76bdf9-c6db-4ae5-b0f8-35c755e9a320 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:56.918990 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5a76bdf9-c6db-4ae5-b0f8-35c755e9a320 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:56.919787 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5a76bdf9-c6db-4ae5-b0f8-35c755e9a320 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:56.920239 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5a76bdf9-c6db-4ae5-b0f8-35c755e9a320 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:56.920664 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5a76bdf9-c6db-4ae5-b0f8-35c755e9a320 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:56.930451 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-609857b7-569e-4762-8a25-a0a250d9fc2e req-ab52013b-c7b4-4630-914a-9cdeec9e6543 service nova] Creating event network-changed:b59a24c4-8b22-46a9-9862-f49dd8712720 for instance 75bac536-33c8-4759-b20e-616b74cc9911 on hv-cinder-85867 Sep 21 12:39:56.936688 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-609857b7-569e-4762-8a25-a0a250d9fc2e req-ab52013b-c7b4-4630-914a-9cdeec9e6543 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063920 Sep 21 12:39:56.938288 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 596/1205] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:39:56.950796 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-5a76bdf9-c6db-4ae5-b0f8-35c755e9a320 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 75bac536-33c8-4759-b20e-616b74cc9911] Going to try to terminate instance {{(pid=120462) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 12:39:57.063471 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-5a76bdf9-c6db-4ae5-b0f8-35c755e9a320 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "DELETE /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911" status: 204 len: 0 microversion: 2.1 time: 0.193783 Sep 21 12:39:57.064589 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 610/1206] 10.222.0.71 () {58 vars in 1239 bytes} [Wed Sep 21 12:39:56 2022] DELETE /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 21 12:39:57.074652 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-6e18b284-03b0-41c7-99e5-53605a59d20a tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:39:57.075358 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-6e18b284-03b0-41c7-99e5-53605a59d20a tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 75bac536-33c8-4759-b20e-616b74cc9911] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:39:57.082515 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6e18b284-03b0-41c7-99e5-53605a59d20a tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:57.083001 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6e18b284-03b0-41c7-99e5-53605a59d20a tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:57.083649 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6e18b284-03b0-41c7-99e5-53605a59d20a tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:57.084389 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6e18b284-03b0-41c7-99e5-53605a59d20a tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:57.084857 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6e18b284-03b0-41c7-99e5-53605a59d20a tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:57.085293 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6e18b284-03b0-41c7-99e5-53605a59d20a tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:57.269494 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-6e18b284-03b0-41c7-99e5-53605a59d20a tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:39:57.277353 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-6e18b284-03b0-41c7-99e5-53605a59d20a tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911" status: 200 len: 1579 microversion: 2.1 time: 0.207539 Sep 21 12:39:57.277945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 597/1207] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:39:57 2022] GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911 => generated 1579 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:39:58.302332 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-ff430dfb-844e-4998-a35b-9f1f8cd2594b tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:39:58.303181 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-ff430dfb-844e-4998-a35b-9f1f8cd2594b tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 75bac536-33c8-4759-b20e-616b74cc9911] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:39:58.309594 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ff430dfb-844e-4998-a35b-9f1f8cd2594b tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:58.310076 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ff430dfb-844e-4998-a35b-9f1f8cd2594b tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:58.310513 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ff430dfb-844e-4998-a35b-9f1f8cd2594b tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:58.311204 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ff430dfb-844e-4998-a35b-9f1f8cd2594b tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:58.311659 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ff430dfb-844e-4998-a35b-9f1f8cd2594b tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:58.312112 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ff430dfb-844e-4998-a35b-9f1f8cd2594b tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:58.442534 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-ff430dfb-844e-4998-a35b-9f1f8cd2594b tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:39:58.450892 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-ff430dfb-844e-4998-a35b-9f1f8cd2594b tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911" status: 200 len: 1579 microversion: 2.1 time: 0.152860 Sep 21 12:39:58.451467 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 611/1208] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:39:58 2022] GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911 => generated 1579 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:39:59.473896 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-388f043c-67b0-46b5-9b47-17f82675ec14 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:39:59.474518 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-388f043c-67b0-46b5-9b47-17f82675ec14 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 75bac536-33c8-4759-b20e-616b74cc9911] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:39:59.481012 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-388f043c-67b0-46b5-9b47-17f82675ec14 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:59.481498 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-388f043c-67b0-46b5-9b47-17f82675ec14 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:59.481942 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-388f043c-67b0-46b5-9b47-17f82675ec14 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:59.482640 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-388f043c-67b0-46b5-9b47-17f82675ec14 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:39:59.483106 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-388f043c-67b0-46b5-9b47-17f82675ec14 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:39:59.483535 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-388f043c-67b0-46b5-9b47-17f82675ec14 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:39:59.625268 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-388f043c-67b0-46b5-9b47-17f82675ec14 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:39:59.633099 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-388f043c-67b0-46b5-9b47-17f82675ec14 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911" status: 200 len: 1579 microversion: 2.1 time: 0.163069 Sep 21 12:39:59.633674 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 598/1209] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:39:59 2022] GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911 => generated 1579 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:40:00.657253 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-8ac152e3-c5a0-4694-9dd9-e738183a045c tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:00.657852 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-8ac152e3-c5a0-4694-9dd9-e738183a045c tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 75bac536-33c8-4759-b20e-616b74cc9911] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:00.664623 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8ac152e3-c5a0-4694-9dd9-e738183a045c tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:00.665116 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8ac152e3-c5a0-4694-9dd9-e738183a045c tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:00.665557 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8ac152e3-c5a0-4694-9dd9-e738183a045c tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:00.666268 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8ac152e3-c5a0-4694-9dd9-e738183a045c tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:00.666727 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8ac152e3-c5a0-4694-9dd9-e738183a045c tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:00.667162 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8ac152e3-c5a0-4694-9dd9-e738183a045c tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:00.869251 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-8ac152e3-c5a0-4694-9dd9-e738183a045c tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:40:00.879069 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-8ac152e3-c5a0-4694-9dd9-e738183a045c tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911" status: 200 len: 1579 microversion: 2.1 time: 0.225667 Sep 21 12:40:00.879666 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 612/1210] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:40:00 2022] GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911 => generated 1579 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:40:01.905972 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-f8c5c025-4100-493c-af2d-6452a668f1f5 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:01.906591 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-f8c5c025-4100-493c-af2d-6452a668f1f5 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 75bac536-33c8-4759-b20e-616b74cc9911] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:01.913040 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f8c5c025-4100-493c-af2d-6452a668f1f5 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:01.913527 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f8c5c025-4100-493c-af2d-6452a668f1f5 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:01.913975 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f8c5c025-4100-493c-af2d-6452a668f1f5 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:01.914719 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f8c5c025-4100-493c-af2d-6452a668f1f5 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:01.915182 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f8c5c025-4100-493c-af2d-6452a668f1f5 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:01.915618 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-f8c5c025-4100-493c-af2d-6452a668f1f5 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:02.047905 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-f8c5c025-4100-493c-af2d-6452a668f1f5 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:40:02.057621 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-f8c5c025-4100-493c-af2d-6452a668f1f5 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911" status: 200 len: 1460 microversion: 2.1 time: 0.155559 Sep 21 12:40:02.058404 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 599/1211] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:40:01 2022] GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911 => generated 1460 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:40:02.474058 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-3c3a515f-d1e4-41bb-9b72-d6912d888f49 req-0f5dcd08-26d9-4909-af1a-53de1dcee94b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75bac536-33c8-4759-b20e-616b74cc9911", "name": "network-vif-deleted", "tag": "b59a24c4-8b22-46a9-9862-f49dd8712720"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:40:02.485752 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-3c3a515f-d1e4-41bb-9b72-d6912d888f49 req-0f5dcd08-26d9-4909-af1a-53de1dcee94b service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:02.486176 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-3c3a515f-d1e4-41bb-9b72-d6912d888f49 req-0f5dcd08-26d9-4909-af1a-53de1dcee94b service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:02.486607 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-3c3a515f-d1e4-41bb-9b72-d6912d888f49 req-0f5dcd08-26d9-4909-af1a-53de1dcee94b service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:02.499246 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-3c3a515f-d1e4-41bb-9b72-d6912d888f49 req-0f5dcd08-26d9-4909-af1a-53de1dcee94b service nova] Creating event network-vif-deleted:b59a24c4-8b22-46a9-9862-f49dd8712720 for instance 75bac536-33c8-4759-b20e-616b74cc9911 on hv-cinder-85867 Sep 21 12:40:02.505603 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-3c3a515f-d1e4-41bb-9b72-d6912d888f49 req-0f5dcd08-26d9-4909-af1a-53de1dcee94b service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035018 Sep 21 12:40:02.506222 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 613/1212] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:40:03.081479 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-d87b4f5f-15cf-4318-b710-b0c8c9a39e31 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:03.082165 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-d87b4f5f-15cf-4318-b710-b0c8c9a39e31 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 75bac536-33c8-4759-b20e-616b74cc9911] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:03.089104 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d87b4f5f-15cf-4318-b710-b0c8c9a39e31 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:03.089585 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d87b4f5f-15cf-4318-b710-b0c8c9a39e31 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:03.090017 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d87b4f5f-15cf-4318-b710-b0c8c9a39e31 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:03.090967 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d87b4f5f-15cf-4318-b710-b0c8c9a39e31 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:03.091418 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d87b4f5f-15cf-4318-b710-b0c8c9a39e31 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:03.091869 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-d87b4f5f-15cf-4318-b710-b0c8c9a39e31 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:03.156712 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-d87b4f5f-15cf-4318-b710-b0c8c9a39e31 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:40:03.164231 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-d87b4f5f-15cf-4318-b710-b0c8c9a39e31 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911" status: 200 len: 1226 microversion: 2.1 time: 0.086407 Sep 21 12:40:03.165340 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 600/1213] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:40:03 2022] GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:40:04.188230 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-5131ce20-4830-4657-8d14-ddfa5553bee2 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:04.188926 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-5131ce20-4830-4657-8d14-ddfa5553bee2 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 75bac536-33c8-4759-b20e-616b74cc9911] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:04.195790 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5131ce20-4830-4657-8d14-ddfa5553bee2 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:04.196262 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5131ce20-4830-4657-8d14-ddfa5553bee2 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:04.196701 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5131ce20-4830-4657-8d14-ddfa5553bee2 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:04.197390 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5131ce20-4830-4657-8d14-ddfa5553bee2 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:04.197836 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5131ce20-4830-4657-8d14-ddfa5553bee2 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:04.198256 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5131ce20-4830-4657-8d14-ddfa5553bee2 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:04.262968 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-5131ce20-4830-4657-8d14-ddfa5553bee2 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:40:04.270739 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-5131ce20-4830-4657-8d14-ddfa5553bee2 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911" status: 200 len: 1226 microversion: 2.1 time: 0.086757 Sep 21 12:40:04.271317 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 614/1214] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:40:04 2022] GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:40:05.293489 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-342a9c7f-6545-4e80-bc3c-20cd84498453 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:05.294119 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-342a9c7f-6545-4e80-bc3c-20cd84498453 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 75bac536-33c8-4759-b20e-616b74cc9911] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:05.300699 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-342a9c7f-6545-4e80-bc3c-20cd84498453 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:05.301189 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-342a9c7f-6545-4e80-bc3c-20cd84498453 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:05.301632 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-342a9c7f-6545-4e80-bc3c-20cd84498453 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:05.302337 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-342a9c7f-6545-4e80-bc3c-20cd84498453 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:05.302797 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-342a9c7f-6545-4e80-bc3c-20cd84498453 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:05.303228 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-342a9c7f-6545-4e80-bc3c-20cd84498453 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:05.363373 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-342a9c7f-6545-4e80-bc3c-20cd84498453 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:40:05.371695 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-342a9c7f-6545-4e80-bc3c-20cd84498453 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911" status: 200 len: 1226 microversion: 2.1 time: 0.082470 Sep 21 12:40:05.372303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 601/1215] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:40:05 2022] GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:40:06.394507 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-5b3ef245-3a39-4231-b3e2-8150f7abe9e3 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:06.395123 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-5b3ef245-3a39-4231-b3e2-8150f7abe9e3 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 75bac536-33c8-4759-b20e-616b74cc9911] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:06.402246 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5b3ef245-3a39-4231-b3e2-8150f7abe9e3 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:06.402732 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5b3ef245-3a39-4231-b3e2-8150f7abe9e3 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:06.403171 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5b3ef245-3a39-4231-b3e2-8150f7abe9e3 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:06.403899 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5b3ef245-3a39-4231-b3e2-8150f7abe9e3 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:06.404357 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5b3ef245-3a39-4231-b3e2-8150f7abe9e3 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:06.404786 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-5b3ef245-3a39-4231-b3e2-8150f7abe9e3 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:06.467739 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-5b3ef245-3a39-4231-b3e2-8150f7abe9e3 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:40:06.475590 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-5b3ef245-3a39-4231-b3e2-8150f7abe9e3 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911" status: 200 len: 1226 microversion: 2.1 time: 0.084991 Sep 21 12:40:06.476195 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 615/1216] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:40:06 2022] GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:40:07.499953 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-361ddcde-674d-4e37-9945-a6da058cefca tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:07.500637 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-361ddcde-674d-4e37-9945-a6da058cefca tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 75bac536-33c8-4759-b20e-616b74cc9911] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:07.507415 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-361ddcde-674d-4e37-9945-a6da058cefca tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:07.507949 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-361ddcde-674d-4e37-9945-a6da058cefca tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:07.508398 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-361ddcde-674d-4e37-9945-a6da058cefca tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:07.509107 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-361ddcde-674d-4e37-9945-a6da058cefca tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:07.509564 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-361ddcde-674d-4e37-9945-a6da058cefca tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:07.510002 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-361ddcde-674d-4e37-9945-a6da058cefca tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:07.544843 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-361ddcde-674d-4e37-9945-a6da058cefca tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:07.546582 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-361ddcde-674d-4e37-9945-a6da058cefca tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:07.548044 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-361ddcde-674d-4e37-9945-a6da058cefca tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:07.548320 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.objects.instance [None req-361ddcde-674d-4e37-9945-a6da058cefca tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lazy-loading 'fault' on Instance uuid 75bac536-33c8-4759-b20e-616b74cc9911 {{(pid=120463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 12:40:07.592515 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-361ddcde-674d-4e37-9945-a6da058cefca tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:40:07.600252 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-361ddcde-674d-4e37-9945-a6da058cefca tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911" status: 200 len: 1231 microversion: 2.1 time: 0.104335 Sep 21 12:40:07.600962 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 602/1217] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:40:07 2022] GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911 => generated 1231 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:40:08.628012 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-b9f58e2d-a393-4147-b9b9-2d3648489359 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:08.628633 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-b9f58e2d-a393-4147-b9b9-2d3648489359 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 75bac536-33c8-4759-b20e-616b74cc9911] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:08.635687 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b9f58e2d-a393-4147-b9b9-2d3648489359 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:08.636271 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b9f58e2d-a393-4147-b9b9-2d3648489359 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:08.636706 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b9f58e2d-a393-4147-b9b9-2d3648489359 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:08.637412 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b9f58e2d-a393-4147-b9b9-2d3648489359 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:08.638073 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b9f58e2d-a393-4147-b9b9-2d3648489359 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:08.638508 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-b9f58e2d-a393-4147-b9b9-2d3648489359 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:08.652957 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.wsgi [None req-b9f58e2d-a393-4147-b9b9-2d3648489359 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] HTTP exception thrown: Instance 75bac536-33c8-4759-b20e-616b74cc9911 could not be found. Sep 21 12:40:08.655543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-b9f58e2d-a393-4147-b9b9-2d3648489359 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Request method failure captured: Sep 21 12:40:08.655543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: request: GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911 HTTP/1.1 Sep 21 12:40:08.655543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept: application/json Sep 21 12:40:08.655543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept-Encoding: identity Sep 21 12:40:08.655543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Connection: close Sep 21 12:40:08.655543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Length: 0 Sep 21 12:40:08.655543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Type: application/json Sep 21 12:40:08.655543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Host: 10.222.0.71 Sep 21 12:40:08.655543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Openstack-System-Scope: None Sep 21 12:40:08.655543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: User-Agent: python-urllib3/1.26.12 Sep 21 12:40:08.655543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Auth-Token: gAAAAABjKwQ7mVtGlU3tOeX92rrZRhvq2VYruvrHGgXJ-x6HB7a5FAf6iiJT4sPgEcr7-SdKQDZJ-LjcQBki56eZetiD6li-IOsCJ5bmivzx04pzpw8yQ2EjLDrRqjcRHcrjWA4JZhUqaTJY2GQAGV-wHaWlNUG8A0I6MiweneJ9Z6SHCfC-vvs Sep 21 12:40:08.655543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Id: None Sep 21 12:40:08.655543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Name: None Sep 21 12:40:08.655543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Identity-Status: Confirmed Sep 21 12:40:08.655543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Is-Admin-Project: True Sep 21 12:40:08.655543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Id: default Sep 21 12:40:08.655543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Name: Default Sep 21 12:40:08.655543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Id: 04bda0b59d3b4bfabf6f1b84fec0d6a6 Sep 21 12:40:08.655543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Name: tempest-TestVolumeBootPattern-1488736354 Sep 21 12:40:08.655543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Role: reader,member Sep 21 12:40:08.655543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Roles: reader,member Sep 21 12:40:08.657388 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/04bda0b59d3b4bfabf6f1b84fec0d6a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/04bda0b59d3b4bfabf6f1b84fec0d6a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_04bda0b59d3b4bfabf6f1b84fec0d6a6", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/04bda0b59d3b4bfabf6f1b84fec0d6a6"}]}] Sep 21 12:40:08.657388 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant: tempest-TestVolumeBootPattern-1488736354 Sep 21 12:40:08.657388 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Id: 04bda0b59d3b4bfabf6f1b84fec0d6a6 Sep 21 12:40:08.657388 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Name: tempest-TestVolumeBootPattern-1488736354 Sep 21 12:40:08.657388 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User: tempest-TestVolumeBootPattern-1488736354-project Sep 21 12:40:08.657388 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Id: default Sep 21 12:40:08.657388 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Name: Default Sep 21 12:40:08.657388 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Id: f84520fd4b434d99ad0dab1a1dd3b033 Sep 21 12:40:08.657388 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Name: tempest-TestVolumeBootPattern-1488736354-project Sep 21 12:40:08.657388 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: method: > Sep 21 12:40:08.657388 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: exception: Instance 75bac536-33c8-4759-b20e-616b74cc9911 could not be found. Sep 21 12:40:08.657388 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: action_args: {'id': '75bac536-33c8-4759-b20e-616b74cc9911'} Sep 21 12:40:08.658335 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:40:08.658335 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:40:08.658335 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:40:08.658335 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:40:08.658335 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:40:08.658335 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:40:08.658335 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:40:08.658335 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:40:08.658335 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:40:08.658335 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:40:08.658335 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75bac536-33c8-4759-b20e-616b74cc9911 could not be found. Sep 21 12:40:08.658335 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:40:08.658335 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:40:08.658335 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:40:08.658335 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:40:08.658335 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:40:08.658335 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:40:08.658335 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:40:08.658335 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:40:08.658335 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:40:08.659949 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:40:08.659949 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 12:40:08.659949 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 12:40:08.659949 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:40:08.659949 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:40:08.659949 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:40:08.659949 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:40:08.659949 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75bac536-33c8-4759-b20e-616b74cc9911 could not be found. Sep 21 12:40:08.659949 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:40:08.659949 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:40:08.659949 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:40:08.659949 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:40:08.659949 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:40:08.659949 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:40:08.659949 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:40:08.659949 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:40:08.659949 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75bac536-33c8-4759-b20e-616b74cc9911 could not be found. Sep 21 12:40:08.659949 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:40:08.661304 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-b9f58e2d-a393-4147-b9b9-2d3648489359 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Returning 404 to user: Instance 75bac536-33c8-4759-b20e-616b74cc9911 could not be found. {{(pid=120462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:40:08.661304 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-b9f58e2d-a393-4147-b9b9-2d3648489359 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911" status: 404 len: 111 microversion: 2.1 time: 0.036283 Sep 21 12:40:08.661304 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 616/1218] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:40:08 2022] GET /compute/v2.1/servers/75bac536-33c8-4759-b20e-616b74cc9911 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:40:10.784870 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-06e3d18b-3bf2-45f4-9b64-3e3b6c50a89c tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:10.785388 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-06e3d18b-3bf2-45f4-9b64-3e3b6c50a89c tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: ad1c39f2-abf9-471c-bc00-3e667301e142] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:10.792527 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-06e3d18b-3bf2-45f4-9b64-3e3b6c50a89c tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:10.792917 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-06e3d18b-3bf2-45f4-9b64-3e3b6c50a89c tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:10.793361 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-06e3d18b-3bf2-45f4-9b64-3e3b6c50a89c tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:10.794057 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-06e3d18b-3bf2-45f4-9b64-3e3b6c50a89c tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:10.794518 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-06e3d18b-3bf2-45f4-9b64-3e3b6c50a89c tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:10.794945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-06e3d18b-3bf2-45f4-9b64-3e3b6c50a89c tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:10.875865 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.objects.instance [None req-06e3d18b-3bf2-45f4-9b64-3e3b6c50a89c tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lazy-loading 'services' on Instance uuid ad1c39f2-abf9-471c-bc00-3e667301e142 {{(pid=120463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 12:40:10.952924 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-06e3d18b-3bf2-45f4-9b64-3e3b6c50a89c tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "DELETE /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142/os-volume_attachments/6e14084c-68cc-49a2-939a-9f7c9907499d" status: 202 len: 0 microversion: 2.1 time: 0.171773 Sep 21 12:40:10.953608 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 603/1219] 10.222.0.71 () {58 vars in 1416 bytes} [Wed Sep 21 12:40:10 2022] DELETE /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142/os-volume_attachments/6e14084c-68cc-49a2-939a-9f7c9907499d => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 12:40:11.966389 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-1c87224a-fd5a-4ac9-a4fe-d4ef380eeafd tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:11.966930 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-1c87224a-fd5a-4ac9-a4fe-d4ef380eeafd tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 2fcab7c0-b348-4709-b520-255e93f2c145] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:11.969805 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-1d340745-2bc0-4bdf-bf47-26eb72ed60ab req-296fe110-bc3f-42d9-abc9-2ab6431d48ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fcab7c0-b348-4709-b520-255e93f2c145", "tag": "99db1c1d-12a1-4bd0-be9f-bfda671be9cc"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:40:11.974029 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1c87224a-fd5a-4ac9-a4fe-d4ef380eeafd tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:11.974808 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1c87224a-fd5a-4ac9-a4fe-d4ef380eeafd tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:11.975322 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1c87224a-fd5a-4ac9-a4fe-d4ef380eeafd tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:11.976142 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1c87224a-fd5a-4ac9-a4fe-d4ef380eeafd tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:11.976820 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1c87224a-fd5a-4ac9-a4fe-d4ef380eeafd tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:11.977917 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-1c87224a-fd5a-4ac9-a4fe-d4ef380eeafd tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:11.980674 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-1d340745-2bc0-4bdf-bf47-26eb72ed60ab req-296fe110-bc3f-42d9-abc9-2ab6431d48ed service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:11.981374 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-1d340745-2bc0-4bdf-bf47-26eb72ed60ab req-296fe110-bc3f-42d9-abc9-2ab6431d48ed service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:11.981805 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-1d340745-2bc0-4bdf-bf47-26eb72ed60ab req-296fe110-bc3f-42d9-abc9-2ab6431d48ed service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:11.994601 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-1d340745-2bc0-4bdf-bf47-26eb72ed60ab req-296fe110-bc3f-42d9-abc9-2ab6431d48ed service nova] Creating event network-changed:99db1c1d-12a1-4bd0-be9f-bfda671be9cc for instance 2fcab7c0-b348-4709-b520-255e93f2c145 on hv-cinder-85867 Sep 21 12:40:11.999495 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-1d340745-2bc0-4bdf-bf47-26eb72ed60ab req-296fe110-bc3f-42d9-abc9-2ab6431d48ed service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034437 Sep 21 12:40:12.000446 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 604/1220] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:40:12.009063 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-1c87224a-fd5a-4ac9-a4fe-d4ef380eeafd tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 2fcab7c0-b348-4709-b520-255e93f2c145] Going to try to terminate instance {{(pid=120462) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 12:40:12.107312 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-ee7b4753-7d0e-440d-a06a-9af7659c4ab9 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:12.107919 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-ee7b4753-7d0e-440d-a06a-9af7659c4ab9 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: ad1c39f2-abf9-471c-bc00-3e667301e142] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:12.114912 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ee7b4753-7d0e-440d-a06a-9af7659c4ab9 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:12.115407 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ee7b4753-7d0e-440d-a06a-9af7659c4ab9 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:12.117695 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-1c87224a-fd5a-4ac9-a4fe-d4ef380eeafd tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "DELETE /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145" status: 204 len: 0 microversion: 2.1 time: 0.155958 Sep 21 12:40:12.118331 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 617/1221] 10.222.0.71 () {58 vars in 1239 bytes} [Wed Sep 21 12:40:11 2022] DELETE /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 21 12:40:12.119023 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ee7b4753-7d0e-440d-a06a-9af7659c4ab9 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:12.119986 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ee7b4753-7d0e-440d-a06a-9af7659c4ab9 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:12.120611 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ee7b4753-7d0e-440d-a06a-9af7659c4ab9 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:12.121194 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ee7b4753-7d0e-440d-a06a-9af7659c4ab9 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:12.127007 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-8396c875-9ef1-4e1d-91d9-ce2c20b0f2c3 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:12.127703 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-8396c875-9ef1-4e1d-91d9-ce2c20b0f2c3 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 2fcab7c0-b348-4709-b520-255e93f2c145] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:12.134107 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8396c875-9ef1-4e1d-91d9-ce2c20b0f2c3 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:12.134845 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8396c875-9ef1-4e1d-91d9-ce2c20b0f2c3 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:12.135285 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8396c875-9ef1-4e1d-91d9-ce2c20b0f2c3 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:12.136021 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8396c875-9ef1-4e1d-91d9-ce2c20b0f2c3 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:12.136478 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8396c875-9ef1-4e1d-91d9-ce2c20b0f2c3 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:12.136916 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8396c875-9ef1-4e1d-91d9-ce2c20b0f2c3 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:12.151693 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-ee7b4753-7d0e-440d-a06a-9af7659c4ab9 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: ad1c39f2-abf9-471c-bc00-3e667301e142] Going to try to terminate instance {{(pid=120463) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 12:40:12.238554 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-ee7b4753-7d0e-440d-a06a-9af7659c4ab9 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "DELETE /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142" status: 204 len: 0 microversion: 2.1 time: 0.136648 Sep 21 12:40:12.242413 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 605/1222] 10.222.0.71 () {58 vars in 1239 bytes} [Wed Sep 21 12:40:12 2022] DELETE /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 21 12:40:12.248736 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-40276eaf-b111-47cf-8b11-2df8420168cb tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:12.249451 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-40276eaf-b111-47cf-8b11-2df8420168cb tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: ad1c39f2-abf9-471c-bc00-3e667301e142] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:12.256420 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-40276eaf-b111-47cf-8b11-2df8420168cb tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:12.256926 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-40276eaf-b111-47cf-8b11-2df8420168cb tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:12.257376 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-40276eaf-b111-47cf-8b11-2df8420168cb tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:12.258105 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-40276eaf-b111-47cf-8b11-2df8420168cb tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:12.258613 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-40276eaf-b111-47cf-8b11-2df8420168cb tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:12.259043 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-40276eaf-b111-47cf-8b11-2df8420168cb tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:12.291352 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-8396c875-9ef1-4e1d-91d9-ce2c20b0f2c3 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:40:12.299880 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-8396c875-9ef1-4e1d-91d9-ce2c20b0f2c3 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145" status: 200 len: 1578 microversion: 2.1 time: 0.176843 Sep 21 12:40:12.312568 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 618/1223] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:40:12 2022] GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145 => generated 1578 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:40:12.397472 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-40276eaf-b111-47cf-8b11-2df8420168cb tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd757e6ac07be4c79868adee5777dc461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c274a3c4e6954affbfe3d07e849d64b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:40:12.405920 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-40276eaf-b111-47cf-8b11-2df8420168cb tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142" status: 200 len: 1512 microversion: 2.1 time: 0.162157 Sep 21 12:40:12.406501 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 606/1224] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:40:12 2022] GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142 => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:40:13.324098 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-6684ae8c-1f3c-4e62-b4b6-df7939cfcb30 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:13.324700 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-6684ae8c-1f3c-4e62-b4b6-df7939cfcb30 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 2fcab7c0-b348-4709-b520-255e93f2c145] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:13.331216 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6684ae8c-1f3c-4e62-b4b6-df7939cfcb30 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:13.331694 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6684ae8c-1f3c-4e62-b4b6-df7939cfcb30 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:13.332185 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6684ae8c-1f3c-4e62-b4b6-df7939cfcb30 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:13.332886 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6684ae8c-1f3c-4e62-b4b6-df7939cfcb30 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:13.333348 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6684ae8c-1f3c-4e62-b4b6-df7939cfcb30 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:13.333779 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-6684ae8c-1f3c-4e62-b4b6-df7939cfcb30 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:13.429396 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-eede160f-9951-4cc3-9bb8-bee2cbefe618 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:13.430152 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-eede160f-9951-4cc3-9bb8-bee2cbefe618 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: ad1c39f2-abf9-471c-bc00-3e667301e142] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:13.436800 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eede160f-9951-4cc3-9bb8-bee2cbefe618 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:13.437283 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eede160f-9951-4cc3-9bb8-bee2cbefe618 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:13.437718 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eede160f-9951-4cc3-9bb8-bee2cbefe618 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:13.438407 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eede160f-9951-4cc3-9bb8-bee2cbefe618 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:13.438855 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eede160f-9951-4cc3-9bb8-bee2cbefe618 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:13.439278 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eede160f-9951-4cc3-9bb8-bee2cbefe618 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:13.470527 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-6684ae8c-1f3c-4e62-b4b6-df7939cfcb30 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:40:13.479047 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-6684ae8c-1f3c-4e62-b4b6-df7939cfcb30 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145" status: 200 len: 1578 microversion: 2.1 time: 0.158859 Sep 21 12:40:13.479630 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 619/1225] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:40:13 2022] GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:40:13.576793 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-eede160f-9951-4cc3-9bb8-bee2cbefe618 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd757e6ac07be4c79868adee5777dc461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c274a3c4e6954affbfe3d07e849d64b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:40:13.584759 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-eede160f-9951-4cc3-9bb8-bee2cbefe618 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142" status: 200 len: 1512 microversion: 2.1 time: 0.159690 Sep 21 12:40:13.585322 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 607/1226] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:40:13 2022] GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:40:14.502252 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-f527f27b-8e4b-4d04-b2b7-370969452364 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:14.502884 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-f527f27b-8e4b-4d04-b2b7-370969452364 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 2fcab7c0-b348-4709-b520-255e93f2c145] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:14.509805 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f527f27b-8e4b-4d04-b2b7-370969452364 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:14.510282 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f527f27b-8e4b-4d04-b2b7-370969452364 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:14.510712 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f527f27b-8e4b-4d04-b2b7-370969452364 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:14.511390 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f527f27b-8e4b-4d04-b2b7-370969452364 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:14.511866 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f527f27b-8e4b-4d04-b2b7-370969452364 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:14.512293 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-f527f27b-8e4b-4d04-b2b7-370969452364 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:14.609165 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-ea2e2b95-a44d-442d-9b78-93ac62e7f147 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:14.609766 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-ea2e2b95-a44d-442d-9b78-93ac62e7f147 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: ad1c39f2-abf9-471c-bc00-3e667301e142] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:14.620202 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ea2e2b95-a44d-442d-9b78-93ac62e7f147 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:14.621108 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ea2e2b95-a44d-442d-9b78-93ac62e7f147 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:14.621662 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ea2e2b95-a44d-442d-9b78-93ac62e7f147 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:14.622867 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ea2e2b95-a44d-442d-9b78-93ac62e7f147 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:14.623693 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ea2e2b95-a44d-442d-9b78-93ac62e7f147 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:14.624509 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-ea2e2b95-a44d-442d-9b78-93ac62e7f147 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:14.653816 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-f527f27b-8e4b-4d04-b2b7-370969452364 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:40:14.661748 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-f527f27b-8e4b-4d04-b2b7-370969452364 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145" status: 200 len: 1578 microversion: 2.1 time: 0.163414 Sep 21 12:40:14.662324 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 620/1227] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:40:14 2022] GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:40:14.751280 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-ea2e2b95-a44d-442d-9b78-93ac62e7f147 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd757e6ac07be4c79868adee5777dc461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c274a3c4e6954affbfe3d07e849d64b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:40:14.759219 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-ea2e2b95-a44d-442d-9b78-93ac62e7f147 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142" status: 200 len: 1512 microversion: 2.1 time: 0.153953 Sep 21 12:40:14.759715 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 608/1228] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:40:14 2022] GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:40:15.685969 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-75e4a343-2757-4c72-bbb2-edae9979884f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:15.688349 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-75e4a343-2757-4c72-bbb2-edae9979884f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 2fcab7c0-b348-4709-b520-255e93f2c145] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:15.695560 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-75e4a343-2757-4c72-bbb2-edae9979884f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:15.696769 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-75e4a343-2757-4c72-bbb2-edae9979884f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:15.697271 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-75e4a343-2757-4c72-bbb2-edae9979884f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:15.698020 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-75e4a343-2757-4c72-bbb2-edae9979884f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:15.698720 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-75e4a343-2757-4c72-bbb2-edae9979884f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:15.699155 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-75e4a343-2757-4c72-bbb2-edae9979884f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:15.719502 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-4dd3e9aa-d86b-414e-93f1-68676b26151a req-8834a23d-91cf-4c82-8eb8-4be856867fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fcab7c0-b348-4709-b520-255e93f2c145", "name": "network-vif-deleted", "tag": "99db1c1d-12a1-4bd0-be9f-bfda671be9cc"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:40:15.731848 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-4dd3e9aa-d86b-414e-93f1-68676b26151a req-8834a23d-91cf-4c82-8eb8-4be856867fa1 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:15.732349 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-4dd3e9aa-d86b-414e-93f1-68676b26151a req-8834a23d-91cf-4c82-8eb8-4be856867fa1 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:15.732786 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-4dd3e9aa-d86b-414e-93f1-68676b26151a req-8834a23d-91cf-4c82-8eb8-4be856867fa1 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:15.749782 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-4dd3e9aa-d86b-414e-93f1-68676b26151a req-8834a23d-91cf-4c82-8eb8-4be856867fa1 service nova] Creating event network-vif-deleted:99db1c1d-12a1-4bd0-be9f-bfda671be9cc for instance 2fcab7c0-b348-4709-b520-255e93f2c145 on hv-cinder-85867 Sep 21 12:40:15.755775 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-4dd3e9aa-d86b-414e-93f1-68676b26151a req-8834a23d-91cf-4c82-8eb8-4be856867fa1 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040550 Sep 21 12:40:15.756352 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 609/1229] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 12:40:15.783975 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-03dac8bd-d3d8-4836-a276-24a996b38b51 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:15.785106 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-03dac8bd-d3d8-4836-a276-24a996b38b51 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: ad1c39f2-abf9-471c-bc00-3e667301e142] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:15.791688 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-03dac8bd-d3d8-4836-a276-24a996b38b51 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:15.792215 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-03dac8bd-d3d8-4836-a276-24a996b38b51 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:15.792659 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-03dac8bd-d3d8-4836-a276-24a996b38b51 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:15.793375 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-03dac8bd-d3d8-4836-a276-24a996b38b51 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:15.793836 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-03dac8bd-d3d8-4836-a276-24a996b38b51 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:15.794440 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-03dac8bd-d3d8-4836-a276-24a996b38b51 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:15.806300 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-75e4a343-2757-4c72-bbb2-edae9979884f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84520fd4b434d99ad0dab1a1dd3b033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bda0b59d3b4bfabf6f1b84fec0d6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:40:15.815987 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-75e4a343-2757-4c72-bbb2-edae9979884f tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145" status: 200 len: 1391 microversion: 2.1 time: 0.133827 Sep 21 12:40:15.816918 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 621/1230] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:40:15 2022] GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145 => generated 1391 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:40:15.824670 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-75102027-3944-4dfb-8058-420ff98a9285 req-84685737-92e8-4a54-a0d9-a3e3d4e637d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad1c39f2-abf9-471c-bc00-3e667301e142", "name": "network-vif-deleted", "tag": "f63acfcf-38af-4fbd-885a-51ebe549bf21"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:40:15.837087 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-75102027-3944-4dfb-8058-420ff98a9285 req-84685737-92e8-4a54-a0d9-a3e3d4e637d3 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:15.837605 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-75102027-3944-4dfb-8058-420ff98a9285 req-84685737-92e8-4a54-a0d9-a3e3d4e637d3 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:15.838045 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-75102027-3944-4dfb-8058-420ff98a9285 req-84685737-92e8-4a54-a0d9-a3e3d4e637d3 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:15.850054 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-75102027-3944-4dfb-8058-420ff98a9285 req-84685737-92e8-4a54-a0d9-a3e3d4e637d3 service nova] Creating event network-vif-deleted:f63acfcf-38af-4fbd-885a-51ebe549bf21 for instance ad1c39f2-abf9-471c-bc00-3e667301e142 on hv-cinder-85867 Sep 21 12:40:15.856161 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-75102027-3944-4dfb-8058-420ff98a9285 req-84685737-92e8-4a54-a0d9-a3e3d4e637d3 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037558 Sep 21 12:40:15.857160 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 622/1231] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:40:15.864848 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-03dac8bd-d3d8-4836-a276-24a996b38b51 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd757e6ac07be4c79868adee5777dc461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c274a3c4e6954affbfe3d07e849d64b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:40:15.873373 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-03dac8bd-d3d8-4836-a276-24a996b38b51 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142" status: 200 len: 1470 microversion: 2.1 time: 0.094417 Sep 21 12:40:15.873967 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 610/1232] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:40:15 2022] GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142 => generated 1470 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:40:16.842422 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-673ad208-a8fc-4efc-b914-cee1e3870e33 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:16.843126 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-673ad208-a8fc-4efc-b914-cee1e3870e33 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 2fcab7c0-b348-4709-b520-255e93f2c145] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:16.849279 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-673ad208-a8fc-4efc-b914-cee1e3870e33 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:16.849760 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-673ad208-a8fc-4efc-b914-cee1e3870e33 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:16.850198 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-673ad208-a8fc-4efc-b914-cee1e3870e33 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:16.850888 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-673ad208-a8fc-4efc-b914-cee1e3870e33 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:16.851345 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-673ad208-a8fc-4efc-b914-cee1e3870e33 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:16.851790 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-673ad208-a8fc-4efc-b914-cee1e3870e33 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:16.867271 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.wsgi [None req-673ad208-a8fc-4efc-b914-cee1e3870e33 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] HTTP exception thrown: Instance 2fcab7c0-b348-4709-b520-255e93f2c145 could not be found. Sep 21 12:40:16.868984 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-673ad208-a8fc-4efc-b914-cee1e3870e33 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Request method failure captured: Sep 21 12:40:16.868984 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: request: GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145 HTTP/1.1 Sep 21 12:40:16.868984 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept: application/json Sep 21 12:40:16.868984 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept-Encoding: identity Sep 21 12:40:16.868984 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Connection: close Sep 21 12:40:16.868984 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Length: 0 Sep 21 12:40:16.868984 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Type: application/json Sep 21 12:40:16.868984 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Host: 10.222.0.71 Sep 21 12:40:16.868984 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Openstack-System-Scope: None Sep 21 12:40:16.868984 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: User-Agent: python-urllib3/1.26.12 Sep 21 12:40:16.868984 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Auth-Token: gAAAAABjKwQ7mVtGlU3tOeX92rrZRhvq2VYruvrHGgXJ-x6HB7a5FAf6iiJT4sPgEcr7-SdKQDZJ-LjcQBki56eZetiD6li-IOsCJ5bmivzx04pzpw8yQ2EjLDrRqjcRHcrjWA4JZhUqaTJY2GQAGV-wHaWlNUG8A0I6MiweneJ9Z6SHCfC-vvs Sep 21 12:40:16.868984 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Id: None Sep 21 12:40:16.868984 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Name: None Sep 21 12:40:16.868984 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Identity-Status: Confirmed Sep 21 12:40:16.868984 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Is-Admin-Project: True Sep 21 12:40:16.868984 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Id: default Sep 21 12:40:16.868984 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Name: Default Sep 21 12:40:16.868984 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Id: 04bda0b59d3b4bfabf6f1b84fec0d6a6 Sep 21 12:40:16.868984 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Name: tempest-TestVolumeBootPattern-1488736354 Sep 21 12:40:16.868984 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Role: reader,member Sep 21 12:40:16.868984 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Roles: reader,member Sep 21 12:40:16.870774 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/04bda0b59d3b4bfabf6f1b84fec0d6a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/04bda0b59d3b4bfabf6f1b84fec0d6a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_04bda0b59d3b4bfabf6f1b84fec0d6a6", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/04bda0b59d3b4bfabf6f1b84fec0d6a6"}]}] Sep 21 12:40:16.870774 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant: tempest-TestVolumeBootPattern-1488736354 Sep 21 12:40:16.870774 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Id: 04bda0b59d3b4bfabf6f1b84fec0d6a6 Sep 21 12:40:16.870774 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Name: tempest-TestVolumeBootPattern-1488736354 Sep 21 12:40:16.870774 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User: tempest-TestVolumeBootPattern-1488736354-project Sep 21 12:40:16.870774 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Id: default Sep 21 12:40:16.870774 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Name: Default Sep 21 12:40:16.870774 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Id: f84520fd4b434d99ad0dab1a1dd3b033 Sep 21 12:40:16.870774 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Name: tempest-TestVolumeBootPattern-1488736354-project Sep 21 12:40:16.870774 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: method: > Sep 21 12:40:16.870774 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: exception: Instance 2fcab7c0-b348-4709-b520-255e93f2c145 could not be found. Sep 21 12:40:16.870774 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: action_args: {'id': '2fcab7c0-b348-4709-b520-255e93f2c145'} Sep 21 12:40:16.871812 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:40:16.871812 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:40:16.871812 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:40:16.871812 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:40:16.871812 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:40:16.871812 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:40:16.871812 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:40:16.871812 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:40:16.871812 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:40:16.871812 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:40:16.871812 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fcab7c0-b348-4709-b520-255e93f2c145 could not be found. Sep 21 12:40:16.871812 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:40:16.871812 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:40:16.871812 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:40:16.871812 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:40:16.871812 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:40:16.871812 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:40:16.871812 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:40:16.871812 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:40:16.871812 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:40:16.873544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:40:16.873544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 12:40:16.873544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 12:40:16.873544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:40:16.873544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:40:16.873544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:40:16.873544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:40:16.873544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fcab7c0-b348-4709-b520-255e93f2c145 could not be found. Sep 21 12:40:16.873544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:40:16.873544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:40:16.873544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:40:16.873544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:40:16.873544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:40:16.873544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:40:16.873544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:40:16.873544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:40:16.873544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fcab7c0-b348-4709-b520-255e93f2c145 could not be found. Sep 21 12:40:16.873544 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:40:16.875111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-673ad208-a8fc-4efc-b914-cee1e3870e33 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Returning 404 to user: Instance 2fcab7c0-b348-4709-b520-255e93f2c145 could not be found. {{(pid=120462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:40:16.875111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-673ad208-a8fc-4efc-b914-cee1e3870e33 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145" status: 404 len: 111 microversion: 2.1 time: 0.033699 Sep 21 12:40:16.875111 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 623/1233] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:40:16 2022] GET /compute/v2.1/servers/2fcab7c0-b348-4709-b520-255e93f2c145 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:40:16.897682 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-6f5c3b3f-0179-4e0b-916a-51ba6c8ada58 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:16.898271 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-6f5c3b3f-0179-4e0b-916a-51ba6c8ada58 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: ad1c39f2-abf9-471c-bc00-3e667301e142] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:16.905265 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6f5c3b3f-0179-4e0b-916a-51ba6c8ada58 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:16.905746 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6f5c3b3f-0179-4e0b-916a-51ba6c8ada58 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:16.906179 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6f5c3b3f-0179-4e0b-916a-51ba6c8ada58 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:16.906868 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6f5c3b3f-0179-4e0b-916a-51ba6c8ada58 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:16.907314 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6f5c3b3f-0179-4e0b-916a-51ba6c8ada58 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:16.907734 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-6f5c3b3f-0179-4e0b-916a-51ba6c8ada58 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:16.921232 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.wsgi [None req-6f5c3b3f-0179-4e0b-916a-51ba6c8ada58 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] HTTP exception thrown: Instance ad1c39f2-abf9-471c-bc00-3e667301e142 could not be found. Sep 21 12:40:16.922953 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-6f5c3b3f-0179-4e0b-916a-51ba6c8ada58 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Request method failure captured: Sep 21 12:40:16.922953 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: request: GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142 HTTP/1.1 Sep 21 12:40:16.922953 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept: application/json Sep 21 12:40:16.922953 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept-Encoding: identity Sep 21 12:40:16.922953 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Connection: close Sep 21 12:40:16.922953 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Length: 0 Sep 21 12:40:16.922953 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Type: application/json Sep 21 12:40:16.922953 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Host: 10.222.0.71 Sep 21 12:40:16.922953 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Openstack-System-Scope: None Sep 21 12:40:16.922953 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: User-Agent: python-urllib3/1.26.12 Sep 21 12:40:16.922953 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Auth-Token: gAAAAABjKwXodUuAYbDnJqrjx-57wez6_bjtuS3Db_sbPUutaDKpSbPJQY5K92cSiambmrpUr69xVsaeImhn4iVeOV6QKxWcKg4aj-85o4130yi5A6uOVl9pZzHwho6AIgjuk8RSb8Y1Uecw0B64NTg7b3bM9BTx_6Xcv1oDEr6CN9FEVFz_rkM Sep 21 12:40:16.922953 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Id: None Sep 21 12:40:16.922953 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Name: None Sep 21 12:40:16.922953 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Identity-Status: Confirmed Sep 21 12:40:16.922953 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Is-Admin-Project: True Sep 21 12:40:16.922953 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Id: default Sep 21 12:40:16.922953 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Name: Default Sep 21 12:40:16.922953 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Id: c274a3c4e6954affbfe3d07e849d64b7 Sep 21 12:40:16.922953 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1728709496 Sep 21 12:40:16.922953 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Role: reader,member Sep 21 12:40:16.922953 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Roles: reader,member Sep 21 12:40:16.924657 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c274a3c4e6954affbfe3d07e849d64b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c274a3c4e6954affbfe3d07e849d64b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_c274a3c4e6954affbfe3d07e849d64b7", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/c274a3c4e6954affbfe3d07e849d64b7"}]}] Sep 21 12:40:16.924657 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant: tempest-VolumesSnapshotTestJSON-1728709496 Sep 21 12:40:16.924657 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Id: c274a3c4e6954affbfe3d07e849d64b7 Sep 21 12:40:16.924657 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1728709496 Sep 21 12:40:16.924657 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User: tempest-VolumesSnapshotTestJSON-1728709496-project Sep 21 12:40:16.924657 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Id: default Sep 21 12:40:16.924657 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Name: Default Sep 21 12:40:16.924657 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Id: d757e6ac07be4c79868adee5777dc461 Sep 21 12:40:16.924657 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Name: tempest-VolumesSnapshotTestJSON-1728709496-project Sep 21 12:40:16.924657 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: method: > Sep 21 12:40:16.924657 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: exception: Instance ad1c39f2-abf9-471c-bc00-3e667301e142 could not be found. Sep 21 12:40:16.924657 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: action_args: {'id': 'ad1c39f2-abf9-471c-bc00-3e667301e142'} Sep 21 12:40:16.925629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:40:16.925629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:40:16.925629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:40:16.925629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:40:16.925629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:40:16.925629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:40:16.925629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:40:16.925629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:40:16.925629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:40:16.925629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:40:16.925629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad1c39f2-abf9-471c-bc00-3e667301e142 could not be found. Sep 21 12:40:16.925629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:40:16.925629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:40:16.925629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:40:16.925629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:40:16.925629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:40:16.925629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:40:16.925629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:40:16.925629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:40:16.925629 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:40:16.927303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:40:16.927303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 12:40:16.927303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 12:40:16.927303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:40:16.927303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:40:16.927303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:40:16.927303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:40:16.927303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad1c39f2-abf9-471c-bc00-3e667301e142 could not be found. Sep 21 12:40:16.927303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:40:16.927303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:40:16.927303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:40:16.927303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:40:16.927303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:40:16.927303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:40:16.927303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:40:16.927303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:40:16.927303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad1c39f2-abf9-471c-bc00-3e667301e142 could not be found. Sep 21 12:40:16.927303 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:40:16.928724 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-6f5c3b3f-0179-4e0b-916a-51ba6c8ada58 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Returning 404 to user: Instance ad1c39f2-abf9-471c-bc00-3e667301e142 could not be found. {{(pid=120463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:40:16.928724 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-6f5c3b3f-0179-4e0b-916a-51ba6c8ada58 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142" status: 404 len: 111 microversion: 2.1 time: 0.030699 Sep 21 12:40:16.928724 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 611/1234] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:40:16 2022] GET /compute/v2.1/servers/ad1c39f2-abf9-471c-bc00-3e667301e142 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:40:17.332550 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-a6792307-0f44-4b3e-88a8-0443fd9dca03 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:17.333050 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-a6792307-0f44-4b3e-88a8-0443fd9dca03 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:17.338993 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a6792307-0f44-4b3e-88a8-0443fd9dca03 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:17.339482 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a6792307-0f44-4b3e-88a8-0443fd9dca03 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:17.339954 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a6792307-0f44-4b3e-88a8-0443fd9dca03 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:17.340908 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a6792307-0f44-4b3e-88a8-0443fd9dca03 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:17.341364 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a6792307-0f44-4b3e-88a8-0443fd9dca03 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:17.341831 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a6792307-0f44-4b3e-88a8-0443fd9dca03 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:17.355322 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.wsgi [None req-a6792307-0f44-4b3e-88a8-0443fd9dca03 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] HTTP exception thrown: Instance 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 could not be found. Sep 21 12:40:17.356933 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-a6792307-0f44-4b3e-88a8-0443fd9dca03 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Request method failure captured: Sep 21 12:40:17.356933 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: request: DELETE /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 HTTP/1.1 Sep 21 12:40:17.356933 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept: application/json Sep 21 12:40:17.356933 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept-Encoding: identity Sep 21 12:40:17.356933 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Connection: close Sep 21 12:40:17.356933 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Length: 0 Sep 21 12:40:17.356933 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Type: application/json Sep 21 12:40:17.356933 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Host: 10.222.0.71 Sep 21 12:40:17.356933 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Openstack-System-Scope: None Sep 21 12:40:17.356933 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: User-Agent: python-urllib3/1.26.12 Sep 21 12:40:17.356933 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Auth-Token: gAAAAABjKwQ7mVtGlU3tOeX92rrZRhvq2VYruvrHGgXJ-x6HB7a5FAf6iiJT4sPgEcr7-SdKQDZJ-LjcQBki56eZetiD6li-IOsCJ5bmivzx04pzpw8yQ2EjLDrRqjcRHcrjWA4JZhUqaTJY2GQAGV-wHaWlNUG8A0I6MiweneJ9Z6SHCfC-vvs Sep 21 12:40:17.356933 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Id: None Sep 21 12:40:17.356933 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Name: None Sep 21 12:40:17.356933 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Identity-Status: Confirmed Sep 21 12:40:17.356933 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Is-Admin-Project: True Sep 21 12:40:17.356933 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Id: default Sep 21 12:40:17.356933 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Name: Default Sep 21 12:40:17.356933 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Id: 04bda0b59d3b4bfabf6f1b84fec0d6a6 Sep 21 12:40:17.356933 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Name: tempest-TestVolumeBootPattern-1488736354 Sep 21 12:40:17.356933 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Role: reader,member Sep 21 12:40:17.356933 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Roles: reader,member Sep 21 12:40:17.358649 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/04bda0b59d3b4bfabf6f1b84fec0d6a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/04bda0b59d3b4bfabf6f1b84fec0d6a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_04bda0b59d3b4bfabf6f1b84fec0d6a6", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/04bda0b59d3b4bfabf6f1b84fec0d6a6"}]}] Sep 21 12:40:17.358649 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant: tempest-TestVolumeBootPattern-1488736354 Sep 21 12:40:17.358649 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Id: 04bda0b59d3b4bfabf6f1b84fec0d6a6 Sep 21 12:40:17.358649 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Name: tempest-TestVolumeBootPattern-1488736354 Sep 21 12:40:17.358649 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User: tempest-TestVolumeBootPattern-1488736354-project Sep 21 12:40:17.358649 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Id: default Sep 21 12:40:17.358649 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Name: Default Sep 21 12:40:17.358649 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Id: f84520fd4b434d99ad0dab1a1dd3b033 Sep 21 12:40:17.358649 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Name: tempest-TestVolumeBootPattern-1488736354-project Sep 21 12:40:17.358649 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: method: > Sep 21 12:40:17.358649 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: exception: Instance 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 could not be found. Sep 21 12:40:17.358649 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: action_args: {'id': '03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23'} Sep 21 12:40:17.359538 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:40:17.359538 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:40:17.359538 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:40:17.359538 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:40:17.359538 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:40:17.359538 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:40:17.359538 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:40:17.359538 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:40:17.359538 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:40:17.359538 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:40:17.359538 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 could not be found. Sep 21 12:40:17.359538 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:40:17.359538 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:40:17.359538 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:40:17.359538 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:40:17.359538 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:40:17.359538 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:40:17.359538 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:40:17.359538 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:40:17.359538 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:40:17.361178 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:40:17.361178 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 21 12:40:17.361178 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 21 12:40:17.361178 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 21 12:40:17.361178 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 21 12:40:17.361178 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:40:17.361178 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:40:17.361178 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:40:17.361178 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:40:17.361178 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 could not be found. Sep 21 12:40:17.361178 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:40:17.361178 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:40:17.361178 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:40:17.361178 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:40:17.361178 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:40:17.361178 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:40:17.361178 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:40:17.361178 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:40:17.361178 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 could not be found. Sep 21 12:40:17.361178 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:40:17.363049 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-a6792307-0f44-4b3e-88a8-0443fd9dca03 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Returning 404 to user: Instance 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 could not be found. {{(pid=120462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:40:17.363049 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-a6792307-0f44-4b3e-88a8-0443fd9dca03 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "DELETE /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23" status: 404 len: 111 microversion: 2.1 time: 0.029825 Sep 21 12:40:17.363049 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 624/1235] 10.222.0.71 () {58 vars in 1239 bytes} [Wed Sep 21 12:40:17 2022] DELETE /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:40:17.366838 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-eda4778d-d78b-4e0e-a789-78401fc842df tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:17.367458 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-eda4778d-d78b-4e0e-a789-78401fc842df tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] [instance: 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:17.373883 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eda4778d-d78b-4e0e-a789-78401fc842df tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:17.374362 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eda4778d-d78b-4e0e-a789-78401fc842df tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:17.374799 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eda4778d-d78b-4e0e-a789-78401fc842df tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:17.375485 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eda4778d-d78b-4e0e-a789-78401fc842df tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:17.375971 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eda4778d-d78b-4e0e-a789-78401fc842df tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:17.376400 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-eda4778d-d78b-4e0e-a789-78401fc842df tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:17.390256 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.wsgi [None req-eda4778d-d78b-4e0e-a789-78401fc842df tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] HTTP exception thrown: Instance 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 could not be found. Sep 21 12:40:17.391839 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-eda4778d-d78b-4e0e-a789-78401fc842df tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Request method failure captured: Sep 21 12:40:17.391839 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: request: GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 HTTP/1.1 Sep 21 12:40:17.391839 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept: application/json Sep 21 12:40:17.391839 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Accept-Encoding: identity Sep 21 12:40:17.391839 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Connection: close Sep 21 12:40:17.391839 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Length: 0 Sep 21 12:40:17.391839 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Content-Type: application/json Sep 21 12:40:17.391839 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Host: 10.222.0.71 Sep 21 12:40:17.391839 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: Openstack-System-Scope: None Sep 21 12:40:17.391839 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: User-Agent: python-urllib3/1.26.12 Sep 21 12:40:17.391839 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Auth-Token: gAAAAABjKwQ7mVtGlU3tOeX92rrZRhvq2VYruvrHGgXJ-x6HB7a5FAf6iiJT4sPgEcr7-SdKQDZJ-LjcQBki56eZetiD6li-IOsCJ5bmivzx04pzpw8yQ2EjLDrRqjcRHcrjWA4JZhUqaTJY2GQAGV-wHaWlNUG8A0I6MiweneJ9Z6SHCfC-vvs Sep 21 12:40:17.391839 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Id: None Sep 21 12:40:17.391839 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Domain-Name: None Sep 21 12:40:17.391839 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Identity-Status: Confirmed Sep 21 12:40:17.391839 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Is-Admin-Project: True Sep 21 12:40:17.391839 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Id: default Sep 21 12:40:17.391839 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Domain-Name: Default Sep 21 12:40:17.391839 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Id: 04bda0b59d3b4bfabf6f1b84fec0d6a6 Sep 21 12:40:17.391839 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Project-Name: tempest-TestVolumeBootPattern-1488736354 Sep 21 12:40:17.391839 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Role: reader,member Sep 21 12:40:17.391839 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Roles: reader,member Sep 21 12:40:17.393427 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/04bda0b59d3b4bfabf6f1b84fec0d6a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/04bda0b59d3b4bfabf6f1b84fec0d6a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_04bda0b59d3b4bfabf6f1b84fec0d6a6", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/04bda0b59d3b4bfabf6f1b84fec0d6a6"}]}] Sep 21 12:40:17.393427 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant: tempest-TestVolumeBootPattern-1488736354 Sep 21 12:40:17.393427 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Id: 04bda0b59d3b4bfabf6f1b84fec0d6a6 Sep 21 12:40:17.393427 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-Tenant-Name: tempest-TestVolumeBootPattern-1488736354 Sep 21 12:40:17.393427 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User: tempest-TestVolumeBootPattern-1488736354-project Sep 21 12:40:17.393427 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Id: default Sep 21 12:40:17.393427 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Domain-Name: Default Sep 21 12:40:17.393427 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Id: f84520fd4b434d99ad0dab1a1dd3b033 Sep 21 12:40:17.393427 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: X-User-Name: tempest-TestVolumeBootPattern-1488736354-project Sep 21 12:40:17.393427 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: method: > Sep 21 12:40:17.393427 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: exception: Instance 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 could not be found. Sep 21 12:40:17.393427 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: action_args: {'id': '03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23'} Sep 21 12:40:17.394283 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:40:17.394283 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:40:17.394283 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:40:17.394283 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:40:17.394283 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:40:17.394283 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:40:17.394283 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:40:17.394283 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:40:17.394283 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:40:17.394283 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:40:17.394283 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 could not be found. Sep 21 12:40:17.394283 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:40:17.394283 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:40:17.394283 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:40:17.394283 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:40:17.394283 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:40:17.394283 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:40:17.394283 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:40:17.394283 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:40:17.394283 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:40:17.395680 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:40:17.395680 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 12:40:17.395680 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 12:40:17.395680 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:40:17.395680 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:40:17.395680 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:40:17.395680 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:40:17.395680 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 could not be found. Sep 21 12:40:17.395680 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:40:17.395680 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:40:17.395680 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:40:17.395680 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:40:17.395680 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:40:17.395680 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:40:17.395680 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:40:17.395680 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:40:17.395680 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 could not be found. Sep 21 12:40:17.395680 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: ERROR nova.api.openstack.wsgi Sep 21 12:40:17.396945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-eda4778d-d78b-4e0e-a789-78401fc842df tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Returning 404 to user: Instance 03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 could not be found. {{(pid=120463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:40:17.396945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-eda4778d-d78b-4e0e-a789-78401fc842df tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23" status: 404 len: 111 microversion: 2.1 time: 0.030148 Sep 21 12:40:17.396945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 612/1236] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:40:17 2022] GET /compute/v2.1/servers/03c6adc5-7b9f-4ffa-b4c8-13ca7ae2ee23 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 12:40:21.861609 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-18453837-cbd5-43e1-975d-919c5864ee44 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] Calling method '.version_select at 0x7fe4cc6baca0>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:21.884297 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-18453837-cbd5-43e1-975d-919c5864ee44 tempest-TestVolumeBootPattern-1488736354 tempest-TestVolumeBootPattern-1488736354-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1277426818" status: 202 len: 0 microversion: 2.1 time: 0.025936 Sep 21 12:40:21.884889 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 625/1237] 10.222.0.71 () {58 vars in 1263 bytes} [Wed Sep 21 12:40:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1277426818 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 12:40:26.810087 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-13d34f12-52af-4cab-b312-164e122a4b98 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-419838655", "imageRef": "1e3a8d95-6338-499c-af91-e3d1345af950", "flavorRef": "452", "networks": [{"uuid": "78a46204-c7f5-4031-b525-9dd641483b1c"}]}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:40:26.876698 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.network.neutron [None req-13d34f12-52af-4cab-b312-164e122a4b98 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] validate_networks() for [('78a46204-c7f5-4031-b525-9dd641483b1c', None, None, None, None, None)] {{(pid=120463) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 12:40:27.380857 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:40:27.578210 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-13d34f12-52af-4cab-b312-164e122a4b98 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Flavor limits 0:0:0 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 12:40:27.578373 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-13d34f12-52af-4cab-b312-164e122a4b98 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Image limits 0:0:0 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 12:40:27.578780 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-13d34f12-52af-4cab-b312-164e122a4b98 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Flavor pref 0:0:0 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 12:40:27.579196 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-13d34f12-52af-4cab-b312-164e122a4b98 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Image pref 0:0:0 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 12:40:27.579614 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.virt.hardware [None req-13d34f12-52af-4cab-b312-164e122a4b98 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 12:40:27.581680 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:40:27.593373 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-13d34f12-52af-4cab-b312-164e122a4b98 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:27.593860 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-13d34f12-52af-4cab-b312-164e122a4b98 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:27.594301 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-13d34f12-52af-4cab-b312-164e122a4b98 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:27.595046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-13d34f12-52af-4cab-b312-164e122a4b98 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:27.595501 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-13d34f12-52af-4cab-b312-164e122a4b98 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:27.596040 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-13d34f12-52af-4cab-b312-164e122a4b98 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:27.616700 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.quota [None req-13d34f12-52af-4cab-b312-164e122a4b98 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Getting quotas for project c274a3c4e6954affbfe3d07e849d64b7. Resources: {'instances', 'ram', 'cores'} {{(pid=120463) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 12:40:27.621115 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.quota [None req-13d34f12-52af-4cab-b312-164e122a4b98 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Getting quotas for user d757e6ac07be4c79868adee5777dc461 and project c274a3c4e6954affbfe3d07e849d64b7. Resources: {'instances', 'ram', 'cores'} {{(pid=120463) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 12:40:27.635142 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-13d34f12-52af-4cab-b312-164e122a4b98 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Going to run 1 instances... {{(pid=120463) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 12:40:27.637963 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-13d34f12-52af-4cab-b312-164e122a4b98 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: 7ce405a3-deca-44a9-8481-d3a2a8c6a954] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e3a8d95-6338-499c-af91-e3d1345af950',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 12:40:27.690400 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-13d34f12-52af-4cab-b312-164e122a4b98 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.884798 Sep 21 12:40:27.698084 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 613/1238] 10.222.0.71 () {60 vars in 1147 bytes} [Wed Sep 21 12:40:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 21 12:40:27.700785 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:40:27.705010 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-c10a9292-d937-4986-a071-23871a25c679 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:27.705734 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-c10a9292-d937-4986-a071-23871a25c679 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: 7ce405a3-deca-44a9-8481-d3a2a8c6a954] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:27.707577 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:40:27.786298 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-c10a9292-d937-4986-a071-23871a25c679 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd757e6ac07be4c79868adee5777dc461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c274a3c4e6954affbfe3d07e849d64b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:40:27.793834 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-c10a9292-d937-4986-a071-23871a25c679 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954" status: 200 len: 1218 microversion: 2.1 time: 0.094454 Sep 21 12:40:27.794797 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 626/1239] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:40:27 2022] GET /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:40:28.818919 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-3bfe56a3-6017-4c27-8afa-8d19f7176855 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:28.819715 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-3bfe56a3-6017-4c27-8afa-8d19f7176855 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: 7ce405a3-deca-44a9-8481-d3a2a8c6a954] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:28.829478 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3bfe56a3-6017-4c27-8afa-8d19f7176855 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:28.829976 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3bfe56a3-6017-4c27-8afa-8d19f7176855 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:28.831810 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3bfe56a3-6017-4c27-8afa-8d19f7176855 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:28.832552 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3bfe56a3-6017-4c27-8afa-8d19f7176855 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:28.833142 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3bfe56a3-6017-4c27-8afa-8d19f7176855 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:28.833596 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-3bfe56a3-6017-4c27-8afa-8d19f7176855 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:29.156869 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-3bfe56a3-6017-4c27-8afa-8d19f7176855 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd757e6ac07be4c79868adee5777dc461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c274a3c4e6954affbfe3d07e849d64b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:40:29.167861 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-3bfe56a3-6017-4c27-8afa-8d19f7176855 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954" status: 200 len: 1270 microversion: 2.1 time: 0.353129 Sep 21 12:40:29.168455 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 614/1240] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:40:28 2022] GET /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954 => generated 1270 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:40:30.193232 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-a1ac1491-233d-412e-81cd-696dcfe6a65d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:30.193854 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-a1ac1491-233d-412e-81cd-696dcfe6a65d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: 7ce405a3-deca-44a9-8481-d3a2a8c6a954] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:30.200595 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a1ac1491-233d-412e-81cd-696dcfe6a65d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:30.201091 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a1ac1491-233d-412e-81cd-696dcfe6a65d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:30.201538 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a1ac1491-233d-412e-81cd-696dcfe6a65d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:30.202279 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a1ac1491-233d-412e-81cd-696dcfe6a65d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:30.202744 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a1ac1491-233d-412e-81cd-696dcfe6a65d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:30.203174 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a1ac1491-233d-412e-81cd-696dcfe6a65d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:30.418925 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-a1ac1491-233d-412e-81cd-696dcfe6a65d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd757e6ac07be4c79868adee5777dc461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c274a3c4e6954affbfe3d07e849d64b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:40:30.422985 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-3af10ec4-51f9-46e1-b0f7-56bb992af3f4 req-9b6a59d0-ed1a-47bf-8211-a51b5e6b3ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ce405a3-deca-44a9-8481-d3a2a8c6a954", "tag": "05e0c62b-48dc-4ab9-a5e7-87ac132fb041"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:40:30.428772 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-a1ac1491-233d-412e-81cd-696dcfe6a65d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954" status: 200 len: 1318 microversion: 2.1 time: 0.239142 Sep 21 12:40:30.429586 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 627/1241] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:40:30 2022] GET /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:40:30.434811 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-3af10ec4-51f9-46e1-b0f7-56bb992af3f4 req-9b6a59d0-ed1a-47bf-8211-a51b5e6b3ff8 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:30.435410 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-3af10ec4-51f9-46e1-b0f7-56bb992af3f4 req-9b6a59d0-ed1a-47bf-8211-a51b5e6b3ff8 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:30.435978 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-3af10ec4-51f9-46e1-b0f7-56bb992af3f4 req-9b6a59d0-ed1a-47bf-8211-a51b5e6b3ff8 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:30.456397 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-3af10ec4-51f9-46e1-b0f7-56bb992af3f4 req-9b6a59d0-ed1a-47bf-8211-a51b5e6b3ff8 service nova] Creating event network-changed:05e0c62b-48dc-4ab9-a5e7-87ac132fb041 for instance 7ce405a3-deca-44a9-8481-d3a2a8c6a954 on hv-cinder-85867 Sep 21 12:40:30.462015 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-3af10ec4-51f9-46e1-b0f7-56bb992af3f4 req-9b6a59d0-ed1a-47bf-8211-a51b5e6b3ff8 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042945 Sep 21 12:40:30.462620 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 615/1242] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 12:40:31.455443 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-2b96b560-0154-483c-bf39-c3e4410e1a17 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:31.456077 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-2b96b560-0154-483c-bf39-c3e4410e1a17 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: 7ce405a3-deca-44a9-8481-d3a2a8c6a954] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:31.462997 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2b96b560-0154-483c-bf39-c3e4410e1a17 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:31.463477 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2b96b560-0154-483c-bf39-c3e4410e1a17 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:31.463954 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2b96b560-0154-483c-bf39-c3e4410e1a17 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:31.464648 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2b96b560-0154-483c-bf39-c3e4410e1a17 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:31.465107 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2b96b560-0154-483c-bf39-c3e4410e1a17 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:31.465804 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2b96b560-0154-483c-bf39-c3e4410e1a17 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:31.595126 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-2b96b560-0154-483c-bf39-c3e4410e1a17 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd757e6ac07be4c79868adee5777dc461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c274a3c4e6954affbfe3d07e849d64b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:40:31.603843 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-2b96b560-0154-483c-bf39-c3e4410e1a17 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954" status: 200 len: 1318 microversion: 2.1 time: 0.152210 Sep 21 12:40:31.604415 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 628/1243] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:40:31 2022] GET /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:40:32.627508 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-9f012062-749d-4d49-93dd-a1019539ceb1 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:32.628254 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-9f012062-749d-4d49-93dd-a1019539ceb1 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: 7ce405a3-deca-44a9-8481-d3a2a8c6a954] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:32.634469 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9f012062-749d-4d49-93dd-a1019539ceb1 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:32.634945 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9f012062-749d-4d49-93dd-a1019539ceb1 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:32.635383 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9f012062-749d-4d49-93dd-a1019539ceb1 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:32.636107 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9f012062-749d-4d49-93dd-a1019539ceb1 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:32.636558 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9f012062-749d-4d49-93dd-a1019539ceb1 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:32.636980 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9f012062-749d-4d49-93dd-a1019539ceb1 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:32.765424 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-9f012062-749d-4d49-93dd-a1019539ceb1 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd757e6ac07be4c79868adee5777dc461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c274a3c4e6954affbfe3d07e849d64b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:40:32.773175 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-9f012062-749d-4d49-93dd-a1019539ceb1 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954" status: 200 len: 1318 microversion: 2.1 time: 0.150386 Sep 21 12:40:32.773732 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 616/1244] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:40:32 2022] GET /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:40:33.795970 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-2b8ddb3d-acbf-4b2e-83b5-6d009018550c tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:33.796523 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-2b8ddb3d-acbf-4b2e-83b5-6d009018550c tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: 7ce405a3-deca-44a9-8481-d3a2a8c6a954] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:33.803040 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2b8ddb3d-acbf-4b2e-83b5-6d009018550c tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:33.803523 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2b8ddb3d-acbf-4b2e-83b5-6d009018550c tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:33.804003 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2b8ddb3d-acbf-4b2e-83b5-6d009018550c tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:33.804699 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2b8ddb3d-acbf-4b2e-83b5-6d009018550c tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:33.805647 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2b8ddb3d-acbf-4b2e-83b5-6d009018550c tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:33.806074 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-2b8ddb3d-acbf-4b2e-83b5-6d009018550c tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:33.933443 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-2b8ddb3d-acbf-4b2e-83b5-6d009018550c tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd757e6ac07be4c79868adee5777dc461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c274a3c4e6954affbfe3d07e849d64b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:40:33.941009 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-2b8ddb3d-acbf-4b2e-83b5-6d009018550c tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954" status: 200 len: 1318 microversion: 2.1 time: 0.149000 Sep 21 12:40:33.941588 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 629/1245] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:40:33 2022] GET /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:40:34.964446 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-9c082580-433b-4a58-96c1-d3b66b03f700 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:34.965014 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-9c082580-433b-4a58-96c1-d3b66b03f700 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: 7ce405a3-deca-44a9-8481-d3a2a8c6a954] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:34.971577 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9c082580-433b-4a58-96c1-d3b66b03f700 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:34.972175 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9c082580-433b-4a58-96c1-d3b66b03f700 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:34.972620 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9c082580-433b-4a58-96c1-d3b66b03f700 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:34.973359 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9c082580-433b-4a58-96c1-d3b66b03f700 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:34.973851 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9c082580-433b-4a58-96c1-d3b66b03f700 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:34.974286 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-9c082580-433b-4a58-96c1-d3b66b03f700 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:35.115580 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-9c082580-433b-4a58-96c1-d3b66b03f700 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd757e6ac07be4c79868adee5777dc461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c274a3c4e6954affbfe3d07e849d64b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:40:35.123091 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-9c082580-433b-4a58-96c1-d3b66b03f700 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954" status: 200 len: 1318 microversion: 2.1 time: 0.163364 Sep 21 12:40:35.123662 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 617/1246] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:40:34 2022] GET /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:40:36.146203 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-d95d726c-faa8-458c-aa86-ee9ed4a9b05d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:36.146800 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-d95d726c-faa8-458c-aa86-ee9ed4a9b05d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: 7ce405a3-deca-44a9-8481-d3a2a8c6a954] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:36.153652 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d95d726c-faa8-458c-aa86-ee9ed4a9b05d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:36.154126 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d95d726c-faa8-458c-aa86-ee9ed4a9b05d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:36.154559 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d95d726c-faa8-458c-aa86-ee9ed4a9b05d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:36.155240 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d95d726c-faa8-458c-aa86-ee9ed4a9b05d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:36.155686 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d95d726c-faa8-458c-aa86-ee9ed4a9b05d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:36.156138 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-d95d726c-faa8-458c-aa86-ee9ed4a9b05d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:36.287860 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-d95d726c-faa8-458c-aa86-ee9ed4a9b05d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd757e6ac07be4c79868adee5777dc461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c274a3c4e6954affbfe3d07e849d64b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:40:36.296132 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-d95d726c-faa8-458c-aa86-ee9ed4a9b05d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954" status: 200 len: 1318 microversion: 2.1 time: 0.153794 Sep 21 12:40:36.296712 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 630/1247] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:40:36 2022] GET /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:40:36.753336 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [req-2ac33298-0f18-4421-9031-5ab354b4911e req-55d344fa-8a18-4489-b9dc-72436e2abfa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ce405a3-deca-44a9-8481-d3a2a8c6a954", "name": "network-vif-plugged", "status": "completed", "tag": "05e0c62b-48dc-4ab9-a5e7-87ac132fb041"}]} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:40:36.766028 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-2ac33298-0f18-4421-9031-5ab354b4911e req-55d344fa-8a18-4489-b9dc-72436e2abfa2 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:36.766519 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-2ac33298-0f18-4421-9031-5ab354b4911e req-55d344fa-8a18-4489-b9dc-72436e2abfa2 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:36.766951 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [req-2ac33298-0f18-4421-9031-5ab354b4911e req-55d344fa-8a18-4489-b9dc-72436e2abfa2 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:36.778099 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.compute.server_external_events [req-2ac33298-0f18-4421-9031-5ab354b4911e req-55d344fa-8a18-4489-b9dc-72436e2abfa2 service nova] Creating event network-vif-plugged:05e0c62b-48dc-4ab9-a5e7-87ac132fb041 for instance 7ce405a3-deca-44a9-8481-d3a2a8c6a954 on hv-cinder-85867 Sep 21 12:40:36.783046 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [req-2ac33298-0f18-4421-9031-5ab354b4911e req-55d344fa-8a18-4489-b9dc-72436e2abfa2 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033844 Sep 21 12:40:36.783651 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 618/1248] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:40:37.318885 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-3a12ba10-a3f7-4778-ad01-1a88a7cb71d4 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:37.319502 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-3a12ba10-a3f7-4778-ad01-1a88a7cb71d4 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: 7ce405a3-deca-44a9-8481-d3a2a8c6a954] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:37.325918 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3a12ba10-a3f7-4778-ad01-1a88a7cb71d4 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:37.326405 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3a12ba10-a3f7-4778-ad01-1a88a7cb71d4 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:37.326847 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3a12ba10-a3f7-4778-ad01-1a88a7cb71d4 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:37.327547 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3a12ba10-a3f7-4778-ad01-1a88a7cb71d4 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:37.328033 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3a12ba10-a3f7-4778-ad01-1a88a7cb71d4 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:37.328466 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-3a12ba10-a3f7-4778-ad01-1a88a7cb71d4 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:37.458543 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-3a12ba10-a3f7-4778-ad01-1a88a7cb71d4 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd757e6ac07be4c79868adee5777dc461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c274a3c4e6954affbfe3d07e849d64b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:40:37.467081 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-3a12ba10-a3f7-4778-ad01-1a88a7cb71d4 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954" status: 200 len: 1318 microversion: 2.1 time: 0.152057 Sep 21 12:40:37.467651 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 631/1249] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:40:37 2022] GET /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:40:38.487501 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell0:SELECT=2 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:40:38.488236 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell0:SELECT=6 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:40:38.493292 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-65fbb96d-b7cc-43c8-88de-241a66b9c07b tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:38.494027 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-65fbb96d-b7cc-43c8-88de-241a66b9c07b tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: 7ce405a3-deca-44a9-8481-d3a2a8c6a954] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:38.501051 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-65fbb96d-b7cc-43c8-88de-241a66b9c07b tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:38.501532 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-65fbb96d-b7cc-43c8-88de-241a66b9c07b tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:38.501968 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-65fbb96d-b7cc-43c8-88de-241a66b9c07b tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:38.502656 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-65fbb96d-b7cc-43c8-88de-241a66b9c07b tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:38.503108 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-65fbb96d-b7cc-43c8-88de-241a66b9c07b tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:38.503536 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-65fbb96d-b7cc-43c8-88de-241a66b9c07b tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:38.637516 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-65fbb96d-b7cc-43c8-88de-241a66b9c07b tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd757e6ac07be4c79868adee5777dc461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c274a3c4e6954affbfe3d07e849d64b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:40:38.645155 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-65fbb96d-b7cc-43c8-88de-241a66b9c07b tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954" status: 200 len: 1318 microversion: 2.1 time: 0.158612 Sep 21 12:40:38.645843 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 619/1250] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:40:38 2022] GET /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:40:39.667917 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-a775e5fe-7b93-4d46-a3e1-da4967b35821 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:40:39.668567 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-a775e5fe-7b93-4d46-a3e1-da4967b35821 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: 7ce405a3-deca-44a9-8481-d3a2a8c6a954] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:39.670385 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell0:SELECT=2 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:40:39.675970 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a775e5fe-7b93-4d46-a3e1-da4967b35821 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:39.676458 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a775e5fe-7b93-4d46-a3e1-da4967b35821 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:39.676899 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a775e5fe-7b93-4d46-a3e1-da4967b35821 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:39.677596 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a775e5fe-7b93-4d46-a3e1-da4967b35821 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:39.678053 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a775e5fe-7b93-4d46-a3e1-da4967b35821 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:39.678484 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-a775e5fe-7b93-4d46-a3e1-da4967b35821 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:39.808769 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-a775e5fe-7b93-4d46-a3e1-da4967b35821 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd757e6ac07be4c79868adee5777dc461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c274a3c4e6954affbfe3d07e849d64b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:40:39.816466 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-a775e5fe-7b93-4d46-a3e1-da4967b35821 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954" status: 200 len: 1505 microversion: 2.1 time: 0.153179 Sep 21 12:40:39.817072 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 632/1251] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:40:39 2022] GET /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:40:39.839101 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-b59fd3af-8516-46b2-bdcc-090c50e21b84 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93702fe0-a2f9-4464-89ad-0a43a5294640", "device": "/dev/sdb"}} {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:40:39.841732 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-b59fd3af-8516-46b2-bdcc-090c50e21b84 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: 7ce405a3-deca-44a9-8481-d3a2a8c6a954] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:40:39.848109 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b59fd3af-8516-46b2-bdcc-090c50e21b84 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:39.848583 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b59fd3af-8516-46b2-bdcc-090c50e21b84 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:39.849023 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b59fd3af-8516-46b2-bdcc-090c50e21b84 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:39.849703 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b59fd3af-8516-46b2-bdcc-090c50e21b84 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:40:39.850152 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b59fd3af-8516-46b2-bdcc-090c50e21b84 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:40:39.850573 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-b59fd3af-8516-46b2-bdcc-090c50e21b84 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:40:40.108546 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-b59fd3af-8516-46b2-bdcc-090c50e21b84 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "POST /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273745 Sep 21 12:40:40.109167 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 620/1252] 10.222.0.71 () {60 vars in 1323 bytes} [Wed Sep 21 12:40:39 2022] POST /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:41:00.526599 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-84e46af9-c397-4f33-9731-49f7768e9c4a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:41:00.527128 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-84e46af9-c397-4f33-9731-49f7768e9c4a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: 7ce405a3-deca-44a9-8481-d3a2a8c6a954] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:41:00.529511 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_api:SELECT=15 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:41:00.530229 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG dbcounter [-] [120462] Writing DB stats nova_cell1:SELECT=36 {{(pid=120462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:41:00.535668 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-84e46af9-c397-4f33-9731-49f7768e9c4a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:41:00.536192 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-84e46af9-c397-4f33-9731-49f7768e9c4a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:41:00.536634 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-84e46af9-c397-4f33-9731-49f7768e9c4a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:41:00.537340 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-84e46af9-c397-4f33-9731-49f7768e9c4a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:41:00.537801 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-84e46af9-c397-4f33-9731-49f7768e9c4a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:41:00.538232 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-84e46af9-c397-4f33-9731-49f7768e9c4a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:41:00.618368 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.objects.instance [None req-84e46af9-c397-4f33-9731-49f7768e9c4a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lazy-loading 'services' on Instance uuid 7ce405a3-deca-44a9-8481-d3a2a8c6a954 {{(pid=120462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 12:41:00.689012 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-84e46af9-c397-4f33-9731-49f7768e9c4a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "DELETE /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954/os-volume_attachments/93702fe0-a2f9-4464-89ad-0a43a5294640" status: 202 len: 0 microversion: 2.1 time: 0.166726 Sep 21 12:41:00.689642 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 633/1253] 10.222.0.71 () {58 vars in 1416 bytes} [Wed Sep 21 12:41:00 2022] DELETE /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954/os-volume_attachments/93702fe0-a2f9-4464-89ad-0a43a5294640 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 12:41:01.819308 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:41:01.820622 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG dbcounter [-] [120463] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:41:01.826374 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-473c541d-f6e8-4bfc-92a3-ee8b49ac310d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:41:01.826969 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-473c541d-f6e8-4bfc-92a3-ee8b49ac310d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: 7ce405a3-deca-44a9-8481-d3a2a8c6a954] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:41:01.836095 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-473c541d-f6e8-4bfc-92a3-ee8b49ac310d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:41:01.836553 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-473c541d-f6e8-4bfc-92a3-ee8b49ac310d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:41:01.836991 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-473c541d-f6e8-4bfc-92a3-ee8b49ac310d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:41:01.838312 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-473c541d-f6e8-4bfc-92a3-ee8b49ac310d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:41:01.838764 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-473c541d-f6e8-4bfc-92a3-ee8b49ac310d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:41:01.839190 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-473c541d-f6e8-4bfc-92a3-ee8b49ac310d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:41:01.869162 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-473c541d-f6e8-4bfc-92a3-ee8b49ac310d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: 7ce405a3-deca-44a9-8481-d3a2a8c6a954] Going to try to terminate instance {{(pid=120463) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 12:41:01.949229 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-473c541d-f6e8-4bfc-92a3-ee8b49ac310d tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "DELETE /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954" status: 204 len: 0 microversion: 2.1 time: 0.130694 Sep 21 12:41:01.953947 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 621/1254] 10.222.0.71 () {58 vars in 1239 bytes} [Wed Sep 21 12:41:01 2022] DELETE /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 21 12:41:01.960130 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-8fac4675-af2f-43f2-a1de-4f751503913a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:41:01.960837 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-8fac4675-af2f-43f2-a1de-4f751503913a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: 7ce405a3-deca-44a9-8481-d3a2a8c6a954] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:41:01.968080 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8fac4675-af2f-43f2-a1de-4f751503913a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:41:01.968563 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8fac4675-af2f-43f2-a1de-4f751503913a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:41:01.968999 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8fac4675-af2f-43f2-a1de-4f751503913a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:41:01.969694 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8fac4675-af2f-43f2-a1de-4f751503913a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:41:01.970152 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8fac4675-af2f-43f2-a1de-4f751503913a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:41:01.970576 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-8fac4675-af2f-43f2-a1de-4f751503913a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:41:02.099066 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.policy [None req-8fac4675-af2f-43f2-a1de-4f751503913a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd757e6ac07be4c79868adee5777dc461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c274a3c4e6954affbfe3d07e849d64b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120462) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:41:02.106789 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-8fac4675-af2f-43f2-a1de-4f751503913a tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954" status: 200 len: 1511 microversion: 2.1 time: 0.151382 Sep 21 12:41:02.107350 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 634/1255] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:41:01 2022] GET /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954 => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 12:41:03.132554 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-60c75a6c-b289-4ba9-9437-8f5b24773dee tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:41:03.133260 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-60c75a6c-b289-4ba9-9437-8f5b24773dee tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: 7ce405a3-deca-44a9-8481-d3a2a8c6a954] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:41:03.141695 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-60c75a6c-b289-4ba9-9437-8f5b24773dee tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:41:03.142183 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-60c75a6c-b289-4ba9-9437-8f5b24773dee tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:41:03.142622 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-60c75a6c-b289-4ba9-9437-8f5b24773dee tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:41:03.143319 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-60c75a6c-b289-4ba9-9437-8f5b24773dee tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:41:03.143792 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-60c75a6c-b289-4ba9-9437-8f5b24773dee tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:41:03.144219 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-60c75a6c-b289-4ba9-9437-8f5b24773dee tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:41:03.271093 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-60c75a6c-b289-4ba9-9437-8f5b24773dee tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd757e6ac07be4c79868adee5777dc461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c274a3c4e6954affbfe3d07e849d64b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:41:03.278857 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-60c75a6c-b289-4ba9-9437-8f5b24773dee tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954" status: 200 len: 1511 microversion: 2.1 time: 0.150433 Sep 21 12:41:03.279432 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 622/1256] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:41:03 2022] GET /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954 => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:41:04.299915 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [req-223a819f-bc68-4a66-8d3c-0d11cf899d55 req-b7ed6df8-b3a6-4365-b9d5-79e911f11e91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ce405a3-deca-44a9-8481-d3a2a8c6a954", "name": "network-vif-deleted", "tag": "05e0c62b-48dc-4ab9-a5e7-87ac132fb041"}]} {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 12:41:04.303086 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.api.openstack.wsgi [None req-51a6d280-2a74-47c1-af75-46670e54ab97 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:41:04.303862 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.compute.api [None req-51a6d280-2a74-47c1-af75-46670e54ab97 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: 7ce405a3-deca-44a9-8481-d3a2a8c6a954] Fetching instance by UUID {{(pid=120463) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:41:04.310289 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-51a6d280-2a74-47c1-af75-46670e54ab97 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:41:04.310744 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-51a6d280-2a74-47c1-af75-46670e54ab97 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:41:04.310954 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-223a819f-bc68-4a66-8d3c-0d11cf899d55 req-b7ed6df8-b3a6-4365-b9d5-79e911f11e91 service nova] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:41:04.311198 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-51a6d280-2a74-47c1-af75-46670e54ab97 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:41:04.311432 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-223a819f-bc68-4a66-8d3c-0d11cf899d55 req-b7ed6df8-b3a6-4365-b9d5-79e911f11e91 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:41:04.311882 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [req-223a819f-bc68-4a66-8d3c-0d11cf899d55 req-b7ed6df8-b3a6-4365-b9d5-79e911f11e91 service nova] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:41:04.312004 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-51a6d280-2a74-47c1-af75-46670e54ab97 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:41:04.312404 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-51a6d280-2a74-47c1-af75-46670e54ab97 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:41:04.312837 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG oslo_concurrency.lockutils [None req-51a6d280-2a74-47c1-af75-46670e54ab97 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:41:04.324003 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.compute.server_external_events [req-223a819f-bc68-4a66-8d3c-0d11cf899d55 req-b7ed6df8-b3a6-4365-b9d5-79e911f11e91 service nova] Creating event network-vif-deleted:05e0c62b-48dc-4ab9-a5e7-87ac132fb041 for instance 7ce405a3-deca-44a9-8481-d3a2a8c6a954 on hv-cinder-85867 Sep 21 12:41:04.329052 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [req-223a819f-bc68-4a66-8d3c-0d11cf899d55 req-b7ed6df8-b3a6-4365-b9d5-79e911f11e91 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032637 Sep 21 12:41:04.332045 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 635/1257] 10.222.0.71 () {64 vars in 1317 bytes} [Wed Sep 21 12:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 12:41:04.379140 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: DEBUG nova.policy [None req-51a6d280-2a74-47c1-af75-46670e54ab97 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd757e6ac07be4c79868adee5777dc461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c274a3c4e6954affbfe3d07e849d64b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120463) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 12:41:04.388305 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: INFO nova.api.openstack.requestlog [None req-51a6d280-2a74-47c1-af75-46670e54ab97 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954" status: 200 len: 1469 microversion: 2.1 time: 0.089760 Sep 21 12:41:04.389486 dv-cinder-858678-1-iscsi devstack@n-api.service[120463]: [pid: 120463|app: 0|req: 623/1258] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:41:04 2022] GET /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954 => generated 1469 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 12:41:05.412284 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-ae45ca28-93ee-434f-b9b5-1f6fb3e80a46 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Calling method '>' {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 12:41:05.413112 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.compute.api [None req-ae45ca28-93ee-434f-b9b5-1f6fb3e80a46 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] [instance: 7ce405a3-deca-44a9-8481-d3a2a8c6a954] Fetching instance by UUID {{(pid=120462) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 12:41:05.420224 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ae45ca28-93ee-434f-b9b5-1f6fb3e80a46 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:41:05.420719 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ae45ca28-93ee-434f-b9b5-1f6fb3e80a46 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:41:05.421159 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ae45ca28-93ee-434f-b9b5-1f6fb3e80a46 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:41:05.421854 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ae45ca28-93ee-434f-b9b5-1f6fb3e80a46 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Acquiring lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 12:41:05.422314 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ae45ca28-93ee-434f-b9b5-1f6fb3e80a46 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 12:41:05.422742 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG oslo_concurrency.lockutils [None req-ae45ca28-93ee-434f-b9b5-1f6fb3e80a46 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Lock "5e3c3fc2-6e53-4c4a-a73a-c41818930d93" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 12:41:05.435848 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.wsgi [None req-ae45ca28-93ee-434f-b9b5-1f6fb3e80a46 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] HTTP exception thrown: Instance 7ce405a3-deca-44a9-8481-d3a2a8c6a954 could not be found. Sep 21 12:41:05.437525 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-ae45ca28-93ee-434f-b9b5-1f6fb3e80a46 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Request method failure captured: Sep 21 12:41:05.437525 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: request: GET /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954 HTTP/1.1 Sep 21 12:41:05.437525 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept: application/json Sep 21 12:41:05.437525 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Accept-Encoding: identity Sep 21 12:41:05.437525 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Connection: close Sep 21 12:41:05.437525 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Length: 0 Sep 21 12:41:05.437525 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Content-Type: application/json Sep 21 12:41:05.437525 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Host: 10.222.0.71 Sep 21 12:41:05.437525 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: Openstack-System-Scope: None Sep 21 12:41:05.437525 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: User-Agent: python-urllib3/1.26.12 Sep 21 12:41:05.437525 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Auth-Token: gAAAAABjKwXodUuAYbDnJqrjx-57wez6_bjtuS3Db_sbPUutaDKpSbPJQY5K92cSiambmrpUr69xVsaeImhn4iVeOV6QKxWcKg4aj-85o4130yi5A6uOVl9pZzHwho6AIgjuk8RSb8Y1Uecw0B64NTg7b3bM9BTx_6Xcv1oDEr6CN9FEVFz_rkM Sep 21 12:41:05.437525 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Id: None Sep 21 12:41:05.437525 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Domain-Name: None Sep 21 12:41:05.437525 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Identity-Status: Confirmed Sep 21 12:41:05.437525 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Is-Admin-Project: True Sep 21 12:41:05.437525 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Id: default Sep 21 12:41:05.437525 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Domain-Name: Default Sep 21 12:41:05.437525 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Id: c274a3c4e6954affbfe3d07e849d64b7 Sep 21 12:41:05.437525 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1728709496 Sep 21 12:41:05.437525 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Role: reader,member Sep 21 12:41:05.437525 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Roles: reader,member Sep 21 12:41:05.439115 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c274a3c4e6954affbfe3d07e849d64b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c274a3c4e6954affbfe3d07e849d64b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_c274a3c4e6954affbfe3d07e849d64b7", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/c274a3c4e6954affbfe3d07e849d64b7"}]}] Sep 21 12:41:05.439115 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant: tempest-VolumesSnapshotTestJSON-1728709496 Sep 21 12:41:05.439115 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Id: c274a3c4e6954affbfe3d07e849d64b7 Sep 21 12:41:05.439115 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1728709496 Sep 21 12:41:05.439115 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User: tempest-VolumesSnapshotTestJSON-1728709496-project Sep 21 12:41:05.439115 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Id: default Sep 21 12:41:05.439115 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Domain-Name: Default Sep 21 12:41:05.439115 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Id: d757e6ac07be4c79868adee5777dc461 Sep 21 12:41:05.439115 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: X-User-Name: tempest-VolumesSnapshotTestJSON-1728709496-project Sep 21 12:41:05.439115 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: method: > Sep 21 12:41:05.439115 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: exception: Instance 7ce405a3-deca-44a9-8481-d3a2a8c6a954 could not be found. Sep 21 12:41:05.439115 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: action_args: {'id': '7ce405a3-deca-44a9-8481-d3a2a8c6a954'} Sep 21 12:41:05.440035 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: {{(pid=120462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 12:41:05.440035 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:41:05.440035 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 12:41:05.440035 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 12:41:05.440035 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 12:41:05.440035 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 12:41:05.440035 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 12:41:05.440035 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 12:41:05.440035 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 12:41:05.440035 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 12:41:05.440035 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ce405a3-deca-44a9-8481-d3a2a8c6a954 could not be found. Sep 21 12:41:05.440035 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:41:05.440035 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:41:05.440035 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:41:05.440035 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:41:05.440035 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:41:05.440035 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:41:05.440035 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 12:41:05.440035 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 12:41:05.440035 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 12:41:05.441809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 12:41:05.441809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 12:41:05.441809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 12:41:05.441809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 12:41:05.441809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 12:41:05.441809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 12:41:05.441809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 12:41:05.441809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ce405a3-deca-44a9-8481-d3a2a8c6a954 could not be found. Sep 21 12:41:05.441809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:41:05.441809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 12:41:05.441809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:41:05.441809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 12:41:05.441809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 12:41:05.441809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 12:41:05.441809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 12:41:05.441809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 12:41:05.441809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ce405a3-deca-44a9-8481-d3a2a8c6a954 could not be found. Sep 21 12:41:05.441809 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: ERROR nova.api.openstack.wsgi Sep 21 12:41:05.443490 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: DEBUG nova.api.openstack.wsgi [None req-ae45ca28-93ee-434f-b9b5-1f6fb3e80a46 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] Returning 404 to user: Instance 7ce405a3-deca-44a9-8481-d3a2a8c6a954 could not be found. {{(pid=120462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 12:41:05.443490 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: INFO nova.api.openstack.requestlog [None req-ae45ca28-93ee-434f-b9b5-1f6fb3e80a46 tempest-VolumesSnapshotTestJSON-1728709496 tempest-VolumesSnapshotTestJSON-1728709496-project] 10.222.0.71 "GET /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954" status: 404 len: 111 microversion: 2.1 time: 0.031510 Sep 21 12:41:05.443490 dv-cinder-858678-1-iscsi devstack@n-api.service[120462]: [pid: 120462|app: 0|req: 636/1259] 10.222.0.71 () {58 vars in 1236 bytes} [Wed Sep 21 12:41:05 2022] GET /compute/v2.1/servers/7ce405a3-deca-44a9-8481-d3a2a8c6a954 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)